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METHODS OF POPULATING DATA STRUCTURES FOR USE IN 
EVOLUTIONARY SIMULATIONS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is a continuation-in-part of USSN 09/416,837, filed on 
5 October 12, 1999, 

This application also claims priority to "METHODS FOR MAKING 
CHARACTER STRINGS, POLYNUCLEOTIDES AND POLYPEPTIDES HAVING 
DESIRED CHARACTERISTICS" by Selifonov et ai, PCT Application filed on January 18, 
1 999 {filed by the Law Offices of Jonathan Alan Quite, attorney docket no: 02-289-3PC0) 

1 0 which is a continuation-in-part of "METHODS FOR MAKING CHARACTER STRINGS, 
POLYNUCLEOTIDES AND POLYPEPTIDES HAVING DESIRED 
CHARACTERISTICS'* by Selifonov ei at, USSN 09/416,375, filed October 12, 1999, 
which is a non provisional of "METHODS FOR MAKING CHARACTER STRINGS, 
POLYNUCLEOTIDES AND POLYPEPTIDES HAVING DESIRED 

1 5 CHARACTERISTICS" by Selifonov and Stemmer, USSN 60/1 1 6,447, filed January 19, 
1999 and which is also a non-provisional of "METHODS FOR MAKING CHARACTER 
STRINGS, POLYNUCLEOTIDES AND POLYPEPTIDES HAVING DESIRED 
CHARACTERISTICS' 1 by Selifonov and Slemmer, USSN 60/1 38,854, filed February 5, 
1999. 

20 This application also claims priority to "OLIGONUCLEOTIDE MEDIATED 

NUCLEIC ACID RECOMBINATION" by Crameri et at, PCT Application filed on January 
1 8, 1999 (filed by the Law Offices of Jonathan Alan Quite, attorney docket no; 02-296-3PC) 
which is a continuation-in-part of "OLIGONUCLEOTIDE MEDIATED NUCLEIC ACID 
RECOMBINATION" by Crameri ei al., USSN 09/408,392, filed September 28, 1999, which 

25 is a non-provisional of "OLIGONUCLEOTIDE MEDIATED NUCLEIC ACID 

RECOMBINATION" by Crameri et al, USSN 60/1 18,813, filed February 5, 1999 and 
which is also a non-provisional of "OLIGONUCLEOTIDE MEDIATED NUCLEIC ACID 
RECOMBINATION" by Crameri etaL, USSN 60/141,049, filed June 24, 1999. 
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This appiiearion is also related to "USE OF CODON VARIED 
OLIGONUCLEOTIDE SYNTHESIS FOR SYNTHETIC SHUFFLING" by Welch et al., 
USSN 09/408,393, filed September 28, 1999. 

! I f (« 1 ims pi ty to a >. > > • I he 

5 applications, as provided for under 35 U.S.C. §119 and/or 35 U.S.C. § 120, as appropriate. 
AH of these applications are incorporated herein by reference in their entirety for all 
purposes. 

COPYRIGHT STATEMENT 

A portion of the disclosure of this patent document contains materia! which is 
1 0 subject to copyright protection. The copyright owner has no objection to the facsimile 

reproduction by any-one of the patent document or the patent disclosure, as it appears in the 
Patent and Trademark Office patent file or records, but otherwise reserves all copyrightrights 
whatsoever, 

STATEMENT AS TO RIGHTS TO INVENTIONS MADE UNDER FEDERALLY 
15 SPONSORED RESEARCH AND DEVELOPMENT 
1 Not Applicab l e } 

FIELD OF THE INVENTION 

This invention relates to the field of computer modeling and simulations, in 
particular, this invention provides novel methods of populating data structures for use in 
20 evolutionary modeling. 

BACKGROUND OF THE INVENTION 

There is an extensi ve history of the use of computers to simulate and/or 
investigate the evolution of life, of individual genetic systems and/or population 
geneiic/phemuypic systems. The motor propelling most artificial life (Alife) simulations is 
25 an algorithm which allows artificial creatures to evolve and/or adapt to their environment. 
The fiinda" . v ! j i 1 i 'a 1 ! into two dominant categories: learning algorithms (e.g., 

i > * i i i tit ' i t 1 is i i* ry algorith typified, to i 

by genetic algorithms. 

Many artificial life researchers, especially those concerned with higher-order 
30 processes such as learning and adaptation, endow their organisms with a neural net which 
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serves as an artificial brain (see, e.g., Toareteky (1088-1991). Neural Information Processing 
Systems, volume 1-4. Morgan Kaufinann, 1988-1991. Neural networks are learning 
algorithms. They may be trained &g. to classify images into categories. A typical task is to 
recognize to which letter a given h? c h esponds 

5 A neural net is composed of a collection of input-output devices, called 

neurons, which are organized in a (highly connected) network. Normally the network is 
organized into layers: an input layer which receives sensory input, any number of so-called 
hidden layers which perform the actual computations, and an output layer which reports the 
results of these compulations. Training a neural network involves adjusting the strengths of 

1 0 the connections between the neurons in the net. 

The ether major type of biologically inspired fundamental algorithms are the 
evolutionary algorithms. While learning processes (e.g., neural networks) are metaphorically 
based on learning processes in individual organisms, evolutionary algorithms are inspired by 
evolutionary change in populations of individuals. Relative to neural nets, evolutionary 

15 algorithms have only recently gained wide acceptance in academic and industrial circles. 

Evolutionary algorithms are generally iterative. An iteration is typically 
referred to as a "generation". The bask evolutionary algorithm traditionally begins with a 
population of randomly chosen individuals. In each generation, the individuals "compete" 
among themselves to solve a posed problem. Individuals which perform relatively well are 

20 more likely to "survive" to the next generation. Those surviving to the next generation may 
be subject to a small, random modifications. If the algorithm is correctly set up, and the 
problem is indeed one subject to solution in this manner, then as the iteration proceeds the 
population will contain solutions of increasing quality. 

The most popular evolutionary algorithm is the genetic algorithm of J. 

25 Holland (J.H. Holland (1992) Adaptation in Natural and Artificial Systems. University of 
Michigan Press 1975, Reprinted by MIT Press.). The genetic algorithm is widely used in 
practical contexts (e.g.. financial forecasting, management science, etc.). It is particularly 
well-adapted to multivariate problems whose solution space is discontinuous ("rugged") and 
poorly understood. To apply the genetic algorithm, one defines 1) a mapping from the set of 

30 parameter values into the set of (0- 1) bit strings (e.g. character strings), and 2) a mapping 
from bit strings into the reals, the so-called fitness function. 

In most evolutionary algorithms, a set of randomly-chosen bit strings 
constitutes the initial population. In the basic genetic algorithm, a cycle is repeated during 
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which: the fitness of each individual in the population is evaluated; copies of indi viduals are 
made in proportion to their fitness; and the cycle is repeated. The typical starting point for 
such evolutionary algorithms is a set of randomly chosen bi t strings. The use of an 
"arbitrary", random or haphazard starting population can strongly bias the evolutionary 
5 algorithm away from an efficient, accurate or concise solution to the problem at hand, 

particularly where tire algorithm is used to model or analyze a biological history or process. 
Indeed, the only "force" driving the evolutionary algorithm to any solution whatsoever is a 
fitness determination and associated selection pressure. While a solution may eventually be 
reached, because the process starts from a random (e.g. arbitrary) initial state in which the 
10 populat ion members bear no relationship to each other, the population dynamics as the 

algorithm proceeds reveals little or no information reflecting the dynamics of the simulated 
system. 

In addition, evolutionary algorithms are typically relatively high order 

simulations and provide population level information. Specific genetic information, if it. is 
15 present at all, typically exists as an abstract representation of an allele (typically as a single 

character) or allele frequency. Consequently evolutionary algorithms provide little or no 

information regarding events on a molecular level. 

Similarly, neural nets and/or cellular automata, take as their starting point, 

essentially artificial constructs and utilize internal rules (algorithms) to approximate 
20 biological processes. As a consequence such models generally mimic processes or 

raetaprocesses, but again afford little or no information or insight regarding events at the 

molecular level. 

SUMMARY OF THE INVENTION 

This invention provides novel methods of generating "initial" populations 
25 suitable for further computational manipulation, e.g. via genetic/evolutionary algorithms. 
The members of populations generated by the methods of this invention possess varying 
degrees of "relatedness" or "similarity" to each other reflective of the degrees of covariance 
found in naturally occurring populations, in addition, unlike the populations used as input in 
typical evolutionary algorithms, the populations generated by the methods provided herein 
30 typically contain detailed information about individual members and the information is 

typically of sufficient complexity to provide a "continuous" (rather than binary) measure of 
intermember variability and/or relatedness. Indeed the methods of this invention provide 
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detailed coding of molecular information in the individuals comprising the populations 
created according to the methods of this invention. 

Thus, in one embodiment, this invention provides methods of populating a 
data structure with (e.g. generating a collection or library of) character strings. The method 
5 preferably involve i) encoding two or more a biological molecules into character strings to 
provide a collection of two or more different initial character strings wherein each of said 
biological molecules comprises at least about 10 subunits; ii) selecting at least two 
substrings from said character strings; Hi) concatenating said substrings to form one or 
more product strings about the same length as one or more of the initial character strings; iv) 

10 adding the product strings to a collection of strings (a datastrucfure); and v) optionally 
repeating steps (i) or (ii) through (iv) using one or more of said product strings as an initial 
string in the collection of initial character strings. In particularly preferred embodiments, the 
"encoding" comprises encoding one or more nucleic acid sequences and/or one or more 
amino acid sequences into the character strings. The nucleic acid and/or amino acid 

15 sequences can be unknown and/or haphazardly selected, but preferably encode known 
protein(s). In one preferred embodiment, biological molecules are selected such that they 
have at least about 30%, preferably at least about 50%,. more preferably at least about 75%, 
and most preferably at least about 85%, 90%, or even 95% sequence identity with each other. 
In one embodiment, the substring(s) are selected such that the ends of the 

20 substrings occur in character string regions of about 3 to about 300, preferably about 6 to 
about 20, more preferably about 10 to about 100 and most preferably about 20 to about 50 
characters that have higher sequence identity with the corresponding region of another of the 
initial character strings than the overall sequence identity between the same two strings. In 
another embodiment, the selecting can involve selecting substrings such that the ends of said 

25 substrings occur in predefined motifs of about 4 to about 100; preferably from about 4 to 
about 50, even more preferably from about 4 to about 10, still more preferably from about 6 
to about 30 and most preferably from about 6 to about 20 characters. 

In one embodiment, the selecting and concatenating can comprises 
concatenating substrings from two different initial strings such that the concatenation occurs 

30 in a region of abou t three to about twenty characters having higher sequence identity 
between two different initial strings than the overall sequence identity between the two 
different initial strings. The selecting can also comprise aligning two or more of said initial 
character strings to maximize pairwise identity between two or more substrings of the 
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character strings, and selecting a character titat is a member of an aligned pair for the end of 
one substring. 

In certain embodiments, the "adding" step involves calculating the theoretical 
1 P n i i ■ rophobicity, seeo re a her properties ( 

5 protein encoded by the character siring, in one preferred embodiment, the product strings 
are added io the collection (datastrueture) only if they have greater than 30%, preferably 
greater than 50%.. more preferably greater than 75% or 85% sequence identity with the 
initial strings. 

The method can further involve randomly altering one or more characters of 

10 the character strings. This can he accomplished according to a number of methods including, 
but not limited to introducing a random string into the initial string collection and/or utilizing 
a stochastic operator as described herein, in a particularly preferred embodiment, the 
operations described above are performed in a computer. 

in another embodiment, this invention provides a computer program product 

15 comprising computer code that i) encodes two or more a biological molecules into character 
strings to provide a collection of two or more different initial character strings wherein each 
of said biological molecules comprises at least about ten subunits; ii) selects at least two 
substrings from the character strings; in) concatenates the substrings to form one or more 
product strings about the same length as one or more of the initial character strings; iv) adds 

20 the product strings to a collection of strings (i.e.. populates a datastrueture); and v) 

optionally repeats steps (i) or (ii) through (iv) using one or more of the product strings as an 
initial string in the collection of initial character strings. In other words, the computer 
program product comprising computer code that performs the operations described herein. 
The program code can be pro vided in compiled form, as source code, as object code, as an 

25 executable, etc. The program can be provided on any convenient medium, e.g., magnetic 
media, optical media, electronic media, optomagnetic media, etc. The code can also be 
present on a computer, e.g. in memory (dynamic or static memory) on a hard drive, etc. 

In another embodiment, this invention provides a system for generating labels 
(tags) and/or music derived from the sequences of biological molecules. The system 

30 comprises an encoder for encoding two or more initial strings from biological molecules 
{e.g. nucleic acid and/or proteins); an isolator for identifying and selecting substrings from 
the two or more strings; a coneatenator for concatenating the substrings; a data structure for 
storing the concatenated substrings as a collection of strings; a comparator for measuring the 
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number and/or variability of the collection of strings and determining that sufficient strings 
exist in the collection of strings; and a command writer for writing the collection of strings 
into a raw string file. In a preferred embodiment, the isolator comprises a comparator for 
aligning and determining regions of identity between two or more initial strings. Similarly 
5 the comparator may comprise a means for calculating sequence identity and the isolator and 
comparator may optionally share this means. In preferred embodiments, the isolator selects 
substrings such that the ends of said substrings occur in string regions of about three to about 
100 characters that have higher sequence identity with the corresponding region of another 
of the initial character strings than the overall sequence identity between the same two 
10 strings. 

In another embodiment, the isolator selects substrings such that the ends of 
said substrings occur in predefined motifs of about 4 to about 100, preferably from about 4 to 
about 50, even more preferably from about 4 to about JO, still more preferably from about 6 
to about 30 and most preferably from about 6 to about 20 characters. In one embodiment, 

1 5 the isolator and concatenator individually or in combination concatenate substrings from two 
different initial strings such that the concatenation occurs in a region of about 3 to about 300, 
more preferably about 5 to about 200, most preferably from about 10 to about 100 characters 
having higher sequence identity between said two different initial strings than the overall 
sequence identity between said two different initial strings. In one preferred implementation, 

20 the isolator aligns two or more of the initial character strings to maximize pairwisc identi ty 
between two or more substrings of the character strings, and selects a character that is a 
member of art aligned pa ir for the end of one substring. 

The comparator can impose any of a wide variety of selection criteria. Thus, 
in various embodiments, the comparator can calculate theoretical Pi, PK, molecular weight, 

25 hydrophobicity, secondary structure and/or other properties of an encoded protein. In one ' 
preferred embodiment ,ihe comparator adds strings to the data structure only if they have 
greater than 30% identity with the initial strings. 

The system can optionally comprising an operator that randomly alters one or 
more characters of the character strings. In certain embodiments, such an operator can 

30 randomly select and alter one or more occurrences of a particular preselected character in 
said character strings. Preferred datastruetures in this system stores encoded (or 
deconvolved) nucleic acid sequences and/or encoded or deconvolved amino acid sequences. 
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A fi.tn.hcr underst tn . the invention can be had from the de ai .■ 
discussion of specific embodiments below. For purposes of clarity, this discussion refers to 
devices, methods, and concepts in terms of specific examples. However, the method of the 
present invention may operate within a variety of types of logical devices. It is therefore 
5 intended that the invention not be i united except as provided in the attached claims (as 
interpreted under the doctrine of equivalents). 

Furthermore, it is recognized that logic systems can include a wide variety of 
different components and different functions in a modular fashion. Different embodiments 
of a system can include different mixtures of elements and functions and may group various 
10 functions as parts of various elements. For purposes of clarity, the invention is described in 
terms of systems that include many different innovative components and innovative 
combinations of components. No inference should be taken to limit the invention to 
combinations containing all of the innovative components listed in any illustrative 
embodiment in this specification. 

15 DEFINITIONS. 

The terms "character string" "word", "binary string" or "encoded string" 
represent any entity capable of storing sequence information (e.g. the subunit structure of a 
biological molecule such as the nucleotide sequence of a nucleic acid, the amino acid 
sequence of a protein, the sugar sequence of a polysaccharide, etc.). In one embodiment, the 

20 character string can be a simple sequence of characters (letters, numbers, or other symbols) 
or it can be numeric representation of such information in tangible or intangible (e.g. 
electronic, magnetic, etc.) form. The character siring need not be "linear", but can also exist 
in a number of other forms, e.g. a linked list, etc. 

A "character" when used in reference to a character of a charac ter string refers 

25 to a subunit of the string. In a preferred embodiment, the character of a character string 
encodes one subunit of the encoded biological molecule. Thus, for example, in a preferred 
embodiment, where the encoded biological molecule is a protein, a character of the string 
encodes a single amino acid, 

A "motif" refers to a pattern of suhunits comprising a biological molecule. 

30 The motif can refer to a subunit pattern of the uneneoded biological molecule or to a subunit 
pattern of an encoded representation of a biological molecule. 
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The term substring refers to a string that is found within another string. The 
substring can include the full length "parent" string, but typically, the substring represents a 
substring of the full-length string, 

Che term "d cf jr tv > 1 1 1 tia phonal! > > 

5 device for the storage of information, typically multiple "pieces" of information. The data 
structure can be a simple recordation of the information (e.g. a list) or the data structure can 
contain additional information (e.g. annotations) regarding the information contained therein, 
can establish relationships between the various "members" (information "pieces"} of the data 
structure, and can provide pointers or linked to resources external to the data structure, The 

1 0 data structure can be intangible but is rendered tangible when be stored/represented in 
tangible medium. The data structure can represent various information architectures 
including, but not limited to simple lists, linked lists, indexed lists, data tables, indexes, hash 
indices, flat file databases, relational databases, local databases, distributed databases, thin 
client databases, and the like. In preferred embodiments, the data structure provides fields 

1 5 sufficient for the storage of one or more character strings. The data structure is preferably 
organized to permit alignment, of the character strings and, optionally, to store information 
regarding the alignment and/or string similarities and/or string differences. In one 
embodiment this information is in the form of alignment "scores" (e.g., similarity indices) 
and/or alignment maps showing individual subunit (e.g. nucleotide in the ease of nucleic 

20 acid) alignments. The term "encoded character string" refers a representation of a biological 
molecule that preserves desired sequence/structural information regarding that molecule. 

Similarity, when used herein can refer to a similarity measurement between 
the encoded representatton(s) of a molecule (e.g., the initial character strings) or between the 
molecules represented by the encoded character strings, 

25 When referring to operations on strings (e.g. insertions, deletions, 

transformations, etc.) it will be appreciated that the operation can be performed on the 
encoded representation of a biological molecule or on the "molecule." prior to encoding so 
that the encoded representation captures the operation. 

Hie term "subunit" when used in reference to a biological molecule refers to 

30 the characteristic "monomer" of which a biological is composed. Thus, for example, the 
subunit of a nucleic acid is a nucleotide, the subunit of a polypeptide is an amino acid, the 
subunit of a polysaccharide is a sugar, etc. 
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The terms "pool" or "collection" are used interchangeably when used to refer 

to strings, 

A "biological molecule" refers to a molecule typically found in a biological 
organism. Pi erred bi< < 1 molecules include biologic al m :cromolecules that are 
5 typically polymeric in nature being composed of multiple subunits. Typical biological 
molecules include, but are not limited to nucleic acids {formed of nucleotide subunits) 
proteins (formed of amino acid subunits), polysaccharides (formed of sugar subunits), etc. 

The phrase "encoding a biological molecule" re fers to the generation of a 
representation of that biological molecule that preferably contains and can therefore be used 
10 to recreate the information content of the original biological molecule. 

The term "nucleic acid" refers to a dcoxyribonucieotide or ribonucleotide 
polymer in either single- or double-stranded form, and unless otherwise limited, 
encompasses known analogs of natural nucleotides that can function in a similar manner as 
naturally occurring nucleotides. 
15 A "nucleic acid sequence" refers to the order and identity of the nucleotides 

comprising a nucleic acid. 

The terms "polypeptide", "peptide" and "protein" are used interchangeably 
herein to refer to a polymer of amino acid residues. The terms apply to amino acid polymers 
in which one or more amino acid residue is an artificial chemical analogue of a 
20 corresponding naturally occurring amino acid, as well as to naturally occurring amino acid 
polymers, 

A "polypeptide sequence" refers to the order and identity of the amino acids 
comprising a polypeptide. 

The phrase "adding the product strings to a collec tion of strings" as used 

25 herein does not require a mathematical addition. Rather it refers to a process of identifying 
one or more strings as included within a set of strings. This can be accomplished by a 
variety of means including, but not limited to copying or moving the string(s) in question 
into a data structure that is a collection of strings, setting or providing a pointer from the 
string to a data structure that represents a collection of strings, setting a flag associated with 

30 the string indicating its inclusion in a particular set, or simply designating a rule that the 
string(s) so produced are included in the collection. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 Illustrates a flow chart depicting one embodiment of the methods of 

this invention. 

Figure 2 illustrates a select ion and concatenation of subsequences according 
5 to the method(s) of this invention. 

Figure 3 illustrates a selection and concatenation of subsequences according 
to the method(s) of {his invention where the concatenation utilizes an alignment algorithm to 
fix. the order of substrings. 

Figure 4 illustrates a representational digital device 700 according to the 
10 present invention. 

Figure 5 is a chart and relational tree showing percent similarity for different 
subtilisins (an exemplar set of initial character strings). 

Figure 6 is a pairwlse dot-plot alignment showing homology areas for 
different subtilisins. 

1 5 Figure 7 is a pairwise dot-plot alignment showing homology areas for seven 

different: parental subtilisins. 

DETAILED DESCRIPTION 

I, Generating populations of character strings. 

This invention provides novel computational methods to generate 

20 repre ia ns of actual or theoretical populations of entities suitable for use as initial (or 
mature/processed) populations in evolutionary models more preferably in evolutionary 
models typi fied by genetic algorithms. When initialized to reflect features of particular 
biological organisms, the entities generated by the methods of this invention each contain 
significant information regarding underlying molecular biology (e.g. representati ve amino 

25 acid or nucleic acid sequence^)) and thereby permit models based on genetic or other 

algorithms to provide unprecedented level so information regarding evolutionary processes 
at the molecular level, 

In particularly preferred embodiments, the methods of this invention generate 
populations of character strings where each character string represents one or more- 

30 biolo es I King only a few strings as "seeds" the methods generate large 

populations of strings bearing an "evolutionary" relationship to the initial seed members, in 
-11- 
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contrast to traditional genetic algorithms in which initial member sets are arbitrary, 
random/haphazard, or selected for mathematical or re] t >nal convenience, the 
populations generated by the methods of this invention are, in preferred embodiments, 
derived from known existing biological "precursors" (eg-., particular nucleic acid sequences 
and/or polypi de i |ucnces). 

In a preferred embodiment, the methods of this invention involve; 

1; fdc el mg two or more biological molecules; 

2) Encoding the biological molecules into character strings; 

3) Selecting at least two substrings from the character strings; 

4) Concatenating said substrings to form one or more product strings 
about the same length as one or more of the initial character strings; 

5) Adding the product strings to a collection of strings which can be the 
set of initial strings or a separate set; and 

6} Optionally introducing additional variation into the a resulting string 
set; 

?) Optionally adding selection pressure to the resulting string set. 

8) Optionally repeating steps (2) or (3) through (7) using one or more of 

the product strings as an initial string in the collection of initial 

character strings. 
Each of these operations is described in more detail below. 

1L Encoding one or more biological molecules in to character strings. 

The methods of this invention typically utilize one or more "seed" members. 
The "seed" members are preferably representations of one or more biological molecules. 
Thus, the initial steps of preferred embodiments of this invention involve selecting two or 
more biological molecules and encoding the biological molecules into one or more character 
strings. 

A Idfentifying/selectin^ "seed/initial" biological molecule(s). 

Virtually any biological molecule can be used in the methods of this 
invention. However, preferred biological molecules are "polymeric" biological 
macromolecules comprising a multiplicity of "stibunits". Biological tnacromolecules 
particularly well suited to the methods of this invention include, but are not limited to nucleic 
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acids (e.g. .DNA, RNA, etc.), proteins, glycoproteins, carbohydrates, polysaccharides, certain 
fatty acids, and the like. 

When nucleic acids are selected the nucleic acid can be single stranded or 
double stranded ahh» .ash it w ill be appreciated that a single strand is sufficient to 
5 represent/encode a double, stranded nucleic acid. The nucleic acids are preferably known 
nucleic acids. Such nucleic acid sequences can be readily determined from a number of 
sources including, but not limited to public databases (e.g., GenBank), proprietary databases 
(e.g. fncyte databases), scientific publications, commercial or private sequencing 
laboratories, in-house sequencing laboratories, etc. 

1 0 The nucleic acids can include genomic nucleic acids, cDNAs, mRMAs, 

artificial sequences, natural sequences having modified nucleotides, and the like. 

In one preferred embodiment, the two or more biological molecules are 
"related", but not identical Thus, the nucleic acids may represent the same gene or genes 
but differ in the strain, species, genus, family, order, phylum or kingdom from which they 

15 are derived. Similarly, in one embodiment, the protein, polysaccharide, or other molecule(s) 
are the same protein, polysaccharide, or other molecule(s) with differences between the 
molecules resulting from the fact that they are selected from different strains, species, genus, 
families, orders, phyla or kingdoms. 

The biological molecules can represent a single gene product (e.g. an raRNA, 

20 a cDNA, a protein, etc. ) or they can represent a collection of gene products and/or non- 
coding nucleic acids, in certain preferred embodiments, the biological molecules will 
represent members of one or more particular metabolic pathways (e.g. regulatory, signaling 
or synthetic pathways). Thus, for example, the biological molecules can include members 
comprising an entire operon, or a complete hiosynthetic pathway (e.g., the lac operon, 

25 Protein: B-DNA gal operon, the colicin A operon, the lux operon, poiyketide synthesis 
pathways, etc.). 

In certain preferred embodiments, the biological molecules can include any 
number of different, genes, proteins, etc. Thus, in certain embodiments, the biological 
niolecuh . I i ude the total nucleic acid (eg. genomic DNA, cDNA, or mR'NA) or 
30 total protein, or total lipid, etc., of an individual, or multiple individuals of the same or 
different species. 

In certain embodiments, the biological molecules can reflect a 

"representation" of the total population of that species' molecules. High order representation 
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of populations of molecules is accomplished in the laboratory and, according to the methods 
of this in vention can be performed in silico. Methods of representing complex molecules or 
populations of molecules are seen in Representational Difference Analysis (RDA) and 
related techniques (see, e.g., Lisitsyn (1995) Trends Genet., 1 1(8): 303-307, Risinger ei at, 
5 (1994) Mol Carcinog. 11(1): 1348, and Michiets el al. (1998) Nucleic Acids Res, 26: 15 
3608-3610, and references cited therein). 

Particular preferred biological molecules for encoding and manipulation in 
the methods of this invention include proteins and/or the nucleic acids encoding the proteins 
of various classes of molecules such as therapeutic proteins such as erythropoietin (SPG), 

10 insulin, peptide hormones such as human growth hormone; growth factors and cytokines 
such as Neutrophil activating peptide-78, GROo/MGSA, Grop\ GROy, MIP-lcx, MIP-16, 
MCP-1, epidermal growth factor, fibroblast growth factor, hepatocyhte growth factor, 
insulin-like growth factor, the interferons, the interleukins, keratinocyte growth factor, 
leukemia inhibitor)' factor , oneostatin M, FD-ECSF, PDGF, pleiotropin, SCF, c-kit ligand, 

15 angiogenesis factors (e.g. vascular endothelial growth factors VEGF-A, VEGF-B, VEGF-C, 
VEGF-D, placental growth factor (PLGF), etc.), growth factors (e.g. G-CSF, GM-CSF), 
soluble receptors (e.g. I.L4R, IL-13R, 1L-10R, soluble T-ceil receptors, etc.), and the like. 

Other preferred molecules of encoding include, but. are not limited to 
transcription and expression activators. The transcription and expression activators include 

20 genes and/or proteins that modulate cell growth, differentiation, regulation and the like an 
are found in prokaryotes ,viruses, and eukaryotes including fungi, plants and animals, 
Expression activators include, but are not limited to cytokines, inflammatory molecules, 
growth factors, growth factor receptors, and oncogene products, interleukins (e.g., 1L-1, II. - 
2, IL-8, etc.) interferons, FGF, IGF-1, IGF-H, FF, PDGF, TNF ,'fGF-a, TGF-p, EGK, KGF, 

25 SCR/c-kit, CD40L/CD40, VLA-4/VC AM-1 , ICAM- 1/LFA- 1 , and hyalurin/CD44, signal 
ransd ion olecules ani ,a poi nc< :eneprod e.g Mos, RAS, Raf, and 
Met; and transcriptional activators and supressors, e.g., p53, Tat, Fos, Myc, Jun, Myb, Rel, 
and steroid hormone receptors such as those for estrogen, progesterone, testosterone, 
aldosterone, the LDL receptor ligand and coriieosterone. 

30 Preferred molecules for encoding in the methods of this invention also include 

proteins from infectious or otherwise pathogenic organisms e.g. proteins characteristic of 
Aspergillus sp., Candida sp.. E. coli. Siaphyloccoi sp, Streptocel sp., Clostridia sp., Neisseria 
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Ureap/asma Sp., Legionella sp.. Spirochetes; Mycobacteria sp., Acinomyces sp., Nocardia 
sp„ Chlamydia sp., Rickettsia sp., Coxiella sp,, Ehrilichia sp., Rochalimaea, Brucella, 
Yersinia, Fraciselfu, and PasiureUa; protozoa, viruses {-f)RNA viruses,(-) RNA viruses, 
5 Orthomyxoviruses, dsDNA viruses, retroviucs, etc. 

Still other suitable molecules include nucleic acid and/or proteins that act as 
inhibitors of transcription, toxins of crop pests, industrially important ensynies (e.g. 
proteases, nucleases, and lipases) etc. 

Preferred molecules include members of related "families" of nucleic acids or 

10 their encoded proteins, Reiatedness (e.g. inclusion or exclusion from the "family") can be 
determined by protein function and/or by sequence identity with other members of the 
family. Sequence identity can be determined as described herein arid preferred family 
members share at least about 30% sequence identity, more preferably at least about 50% 
sequence identity and most preferably at leas i > - »i.-»,uenee identity. In certain 

15 instances, it is desirable to include molecules that have low (e.g. less than about 30%) 
sequence identity), but significant relatedness. Such methods are well known in the 
bioinibrroatics literature and typically involve incorporation of molecular folding patterns 
with sequence/similarity information. One common implementation of such an approach 
includes "threading algorithms". Threading algorithms detect remote homology by 

20 comparing sequences to structural templates. If the structural similarity between target and 
template is sufficiently large, their relationship can be detected in the absence of significant 
sequence similarity. Threading algorithms are well know to those of skill in the art and can 
be found, for example, in the NCBI Structure Group Threading Package (available from the 
National Center for Biological Information (see, e.g., http://www.ncbi .nlm.nih.gov/ 

25 Structure ilivS! : A RCII/threading.html) and in SeqFold (Molecular Simulations, Inc.). 

B) Encoding the biological molecule into a character string. 

The biological molecule(s) are encoded into character strings. In the simplest 
instance, the character string is identical to the character code used to represent the biological 
molecule. Thus, for example, the character string can comprise the characters A, C, G, T, or 
30 U where a nucleic acid is encoded. Similarly, the standard amino acid nomenclature can be 
used to represent a polypeptide sequence. Alternatively, it will be realized that, to some 
extent, the encoding scheme arbitrary. Thus, for example in the case of nucleic acids the A, 
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acid can be represented as a string of these integers which is itself a single (albeit typically 
large) integer. Other coding schemes are also possible. For example, the biological 
molecule can be encoded into a character string where each "subunit" of the molecule is 
5 encoded into a multi-character representation. Alternatively various compressed 

representations are also possible (e.g., where recurrent motifs are represented only once with 
appropriate pointers identifying each occurrence). 

The biological molecules also need not be encoded into data structures that 
are discrete/single strings. More complicated data structures (e.g. arrays, linked lists, 

.10 indexed structures including, but not limited to databases or data tables, etc.) can also be 
used to encode the biological molecule(s). 

Essentially any data structure capable that permits input, storage, and retrieval 
of a representation of the biological moiccnle(s) is suitable. While these operations can be 
accomplished manually (e.g. with pencil and paper or card-tile, etc.), preferred data 

1.5 structures are data structures that can be manipulated optically and/or electronically and/or 
magnetically and thus permit automated input, storage and output operations (e.g., by a 
computer). 

PL Selecting substrings. 

In a preferred embodiment, the character string encoded biological molecules 
20 provide an initial population of strings from which substrings are selected. Typically at least 
two, substrings are selected with one substring coming from each initial character string. 
Where there are more than two initial character strings, it is not necessary that every initial 
character string provide a substring as long as at least two initial character strings provide 
such substrings. In preferred embodiments, however, at least one substring will be selected 
25 from each initial string. 

A! Substring length. 

There is essentially no limit on the maximum number of substrings that can 
be selected from the initial strings other than the theoretical maximum number of strings that 
can be generated from any given string. Thus, for example, the maximum number of 
30 substrings selected from an initial string is the number of strings generated by a complete 
permutation of the initial string(s). 
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With an initial string of relatively modest length, however, the number of 
permutations is quite high. Thus, in preferred embodiments, the substrings are selected from 
an initial string such thai the substrings do not overlap. Expressed another way, in a 
preferred embodiment, the substrings from any one initial string are selected such that those 
5 substrings, if iigated in the correct order, would reproduce the complete initial string from 
which they are selected, 

Preferred substrings are also selected so as to not be unduly short. Typically a 
substring will be no shorter than the minim string length necessary to represent one subunit 
of the encoded biological molecule. Thus, for example, where the encoded biological 

10 molecule is a nucleic acid the substring will be long enough to at least encode one 

nucleotide. Similarly, where the encoded biological molecule is a polypeptide the substring 
will be long enough to at least encode one amino acid. 

In preferred embodiments, the selected substring encodes at least two, 
preferably at least 4, more preferably at least 10, still snore preferably at least 20, and most 

15 preferably at least 50, 100, 500, or 1000 subunits of the encoded biological molecule. 

Substring length can be chosen to capture a particular level of biological 
organization. For example, a substring can be selected that encodes an entire gene, cDNA, 
mRNA. At a "higher" level of organization, a substring can be selected that encodes a series 
of related genes cDNAs, mRNAs, etc, as might be found in an operon, or a regulatory or 

20 synthetic pathway. At a still "higher" level of organization, the substring can be selected that 
encodes the total nucleic acid (e.g. genomic DMA, total mRNA, total cDNA) of an 
individual. There is essentially no limit to the "level of organization" that is captured in the 
substring^) as long as the initial string from which the substring is selected encodes a higher 
level of organization. Thus, where the substring^) are selected to encode individual genes, 

25 the initial string may encode entire metabolic pathways. Where the substring is selected to 
encode an individual's total nucleic acid, the initial siring may encode the total nucleic acid 
of a population, etc. 

Conversely, the substring can also be selected to encode a subunit of a 
particular level of biological organization. Thus, for example, a substring can be used to 

30 select a particular domain of a protein, a particular region of a chromosome (e.g., a region 
characteristically amplified, deleted or translocated), etc. 
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B) Substring selectio n algorithms. 

Any of a wide variety of approaches can be used to selected the substring^}, 
the particular approach being determined by the problem that is being modeled. Preferred 
selection approaches include, but are not limited to random substring selection, uniform 
5 substring selection, motif-based selection, alignment-based selection, and frequency-biased 
selection. The same, substring selection method need not be applied to every initial character 
string, but rather different substring selection methods can be used for different initial 
strings, in addition, it is possible to apply multiple substring selection methods to any initial 
character string. 

10 . 1, Random substring selection. 

In one simple approach, the substring^) can be selected randomly. Many 
approaches are available for the "random" selection of substrings. For example, where a 
substring^) of minimum length "L" are to be selected from an encoded character string of 
length "M", "cleavage points" can be selected using a random number generator producing 

15 integers (indicating position along the string) ranging from L to M-L (to avoid short terminal 
strings), "internal" substrings of length less than L are discarded. 

in another approach each position along the character string is addressed (<?.g. 
by an integer ranging from 1 to N where N is the length of the character string). A minimum 
substring length "L" and a maximum substring length "M" ate selected. Then a random 

20 number generator is used to generate a number "V" ranging from L to M. The algorithm 

then selects a substring from position i to V" and position V-H become position 1 again. The 
process is then repeated until the initial string is spanned. 

Other methods of randomly selecting substrings are readily devised. For the 
purpose of this invention, "random" selection does not require that the selection process meet 

25 formal statistical requirements for randomness. Pseudorandom or haphazard selection is 
sufficient in this context. 

2. Uiiifo rm su bs t r i » "selection. 

In uniform substring selection, the desired number of substrings to be 
obtained from each initial string is determined. The initial string is then uniformly divided 
30 into the desired number of substrings. Where the initial string length does not permit 
uniform division one or more shorter or longer substrings may be permitted. 
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3..„ Metfftbased selection 

Substrings can be selectc 1 from th fiiti .1 itrinj - ising m >tif-i ised selection 
In this approach, the initial character strmg(s) are scanned for the occurrence of particular 
preselected motifs. The substring is then selected such that fee endpoint(s) of the substring 
5 occur in a predefined relationship to the motif. Thus, for example, the end can be within 
motif or "upstream" or "downstream" a preselected number of summits from the end of the 
motif. 

The motif can be completely arbitrary or it can reflect the properties of a 
physical agent or biological molecule. Thus, for example, where the encoded biological 
1 0 molecule is a nucleic acid, the motif can be selected to reflect the binding specificity of a 
restriction endomiclease (e.g., EcoRv, Hindi!!, BamHL Pvu.IL etc.), a protein binding site, a 
particular intron/exon junction, a transpose n, and the like. Simiiaily where the encoded 
biological molecule is a protein, the motif can reflect a protease binding site, a protein 
binding site, a receptor binding site, a particular ligand, a complementarity determining 
! 5 region, an epitope, etc. 

Similarly, polysaccharides are can contain particular sugar motifs, 
glycoproteins can have particular sugar motifs and/or particular amino acid motifs, etc. 

Motifs need not specifically reflect primary structure of the encoded 
biological molecule. Secondary and tertiary structure motifs are also possible and can be 
20 used to delineate substring endpoints. Thus, for example, an encoded protein may contain a 
characteristic a-heiix, P-sheet, a-helix, motif and the occurrence of this motif can be used to 
delineate substring endpoints. 

Another "higher order" kind of motif can a "meta-motif e.g., as represented 
by a "fragmentation digest." In this approach, a substring endpoint is not determined by the 
25 occurrence of a single motif, but is delineated by coordinated pattern and spaci ng of one or 
more motifs. 

Motifs can also be selected/utilized that do not strictly reflect sequence 
patterns, but rafter the information content of particular domains of the character strings. 
Thus, for example, U.S. Patent 5.867,402 describes a computer system and computation 
30 method for processing sequence signals by a transformation into an information content 
weight matrix, as represented by Rj(b,l). A second transformation follows which applies a 
particular se uen i uial to the information content weight matrix, ll,(h,l) thereby 
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sequence signal . Other approaches to the determination of information content of character 
strings are also known (see also Staden, (1984) Nucleic Acids Res, 12: 505-519; Schneider 
(1 994) Nanotechnohgy 5: 1-8; Merman ei at. (1992) J. Bacterial pp. 3558-3560; Schneider 
5 et al (1990) Nucleic Acids Res., 18(20): 6097-6100; Berg, ei al. (1988) J. Mol. Biol., 
200(4): 709-723). 

Other motifs that are contemplated reflect biological signals. Thus, for 
example, one motif delineating the end of a substring might be a stop codon, or a start codon 
in the case of an encoded nucleic acid, a methionine, or a polyadenylation signal in the case 
10 of a protein, etc. 

The same motif need not be applied to every initial sequence. In addition, 
multiple motifs, meta-mottfs and/or mofif meta-motif combinations can be applied to any 
sequence, 

4. Alignment-based selection. 

15 In another approach substrings are selected by aligning two or more initial 

character strings and choosing regions of high identity between the initial strings m which to 
select the endpoints of the substring(s). Thus, for example, after a sequence alignment, 
substrings may be chosen such that the endpoint of the substrsng(s) occurs within (e.g., in the 
middle of) a region having at least 30%, preferably at least 50%, more preferably at least 

20 70%, still more preferably at least 80%, and most preferably at least 85%, 90%, 95%, or 
even at least 99% sequence identity over a window ranging in length from at least about 5, 
preferably from at least about 10, more preferably from at least about 20, still more 
preferably from at least about 30, and most preferably from at least about 50, 100, 200, 500., 
or even 1000 subuniis. 

25 The terms ''sequence identity" or "percent sequence identity' 1 or "percent 

identity," or percent "homology" in tire context of two or more biological macromolecules 
(e.g. nucleic acids or polypeptides), refer to two or more sequences or subsequences that are 
the same or have a specified percentage of subunits (e.g., amino acid residues or nucleotides) 
that are the same, when compared and aligned for maximum correspondence, as measured 

30 using one a seqi orison algorithms or by visual inspection. 

5 >.! £ < y ft 1 i ICt i 

sequence, to which test sequences are compared. In a preferred embodiment, when using a 
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subsequence coordinates arc designated, if necessary, and sequence algorism program 
parameters are designated. The sequence comparison algorithm then calculates the percent 
sequence identity for the test s<_ qui. i< uh to! eferen : iak<_ based on the 

5 designated program parameters. 

Alignment and sequence comparison algorithms are well known to those of 
skill in the art. For example, optimal alignment of sequences for comparison can be 
algorithms including, but not limited to the local homology algorithm of Smith & Waterman 
(1981) Adv. Apple. Math. 2:482, the homology alignment algorithm of Needle man & Wench 

10 (1970) ./. Mol. Biol. 48:443, by the search for similarity method of Pearson & Lipan (1 988) 
Proe. Natl. Acad. Sic. USA 85:2444, by computerized implementations of these algorithms 
(e.g., GAP, BESTFIT, FASTA, and TFASTA) in commercial modules and/or commercial 
software packages (e.g., the Wisconsin Genetics Software Package, Genetics Computer 
Group. 575 Science Dr., Madison, Wi), or by visual inspection (see generally Amusabk ei 

1 5 ai, supra). 

One example of a useful algorithm is PILEUP. PILEUP creates a multiple 
sequence alignment from a group of related sequences using progressive, pairwise 
alignments to show relationship and percent sequence identity. It also plots a tree or 
endogamy showing the clustering relationships used to create the alignment. PILEUP uses a 

20 simplification of the progressive alignment method of Feng & Doolittie (198?) J. Mol. EvoL 
35:35 1 -360, The method used is similar to the method described by Higgins & Sharp ( 1 989) 
CAB/OS 5: 15 1-153. The program can align up to 300 sequences, each of a maximum length 
of 5,000 nucleotides or amino acids. The multiple alignment procedure begins with the 
pairwise alignment of the two most similar sequences, producing a cluster of two aligned 

25 sequences. This cluster is then aligned to the next most related sequence or cluster of 
aligned sequences. Two clusters of sequences are aligned by a simple extension of the 
pairwise alignment of two individual sequences. The final alignment is achieved by a series 
of progressive, pairwise alignments. The program is run tv j pecific sequences 

and their amino acid or nucleotide coordinates for regions of sequence comparison and by 

30 designating the program parameters. For example, a reference sequence can be compared to 
other test sequences to determine the percent sequence identity relationship using the 
following parameters: default gap weight (3.00), default gap length weight (0.10), and 
weighted end gaps. 
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Another example of algorithm that is sui table for determining percent 
sequence identity and sequence similarity is the BLAST algorithm, which is described in 
Altsehul et al (1990) J. Mot. Biol 215:403-410. Software for performing BLAST analyses 
is publicly available tht ugh the Nat 
5 (http;//ww. rKbimlm.nth.gov/). This algorithm involves first identifying high scoring 
sequence pairs (HSPs) by identifying short words of length W in the query sequence, which 
either match or satisfy some positive-valued threshold score T when aligned with a word of 
the same length in a database sequence. T is referred to as the neighborhood word score 
threshold (Altsehul et al supra). These initial neighborhood word hits act as seeds for 

1 0 initiating searches to fmd longer HSPs containing them. The word hits are then extended m 
both directions along each sequence for as far as the cumulative alignment score can be 
increased. Extension of the word hits in each direction are halted when: the cumulative 
alignment score fails off by the quantity X from its maximum achieved value; the cumulative 
score goes to zero or below, due to the accumulation of one or more negative-scoring residue 

3 5 alignments; or the end of either sequence is reached. The BLAST algorithm parameters W, 
T, and X determine the sensitivity and speed of the alignment. The BLAST program uses as 
defaults a wordlength (W) of 1 1, the BLOSUM62 scoring matrix (see Henifcoff & Henikoff 
(1989) Proc. Natl Acad, Sci. USA 89:10915) alignments (B) of 50, expectation (E) of 10, 
M~5, N---4, and a comparison of both strands. 

20 in addition to calculating percent sequence identity, the BLAST algorithm 

also performs a statistical analysis of the similarity between two sequences {see, e.g., Karlin 
& Altsehul (1993) Proc. Natl Acad. Sci. USA 90:5873-5787). One measure of similarity 
provided by the BLAST algorithm is the smallest sum probability (P(N)), which provides an 
indication of the probability by which a match between two nucleotide or amino acid 

25 sequences would occur by chance. For example, a nucleic acid is considered similar to a 
reference sequence if the smallest sum probability in a comparison of the test nucleic acid to 
the reference nucleic acid is less than about 0.1, more preferably less than about 0.01, and 
most preferably less than about 0.001. 

The above identified s t t i i tended to be exemplary and 

30 not limiting. It will be appreciated that similarity can be determined across the full length of 
the initial character strings or it can be restricted to particular subdomains. 
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5. Frcq uencv-biase d selection. 

In frequency-biased subsequence selection methods, the subsequences are 
selected such that the endpoints of the subsequence(s) occur in a particular relationship to 
subsequence domains that meet a particular preselected frequency criterion. For example, 
5 where it is desired to exclude encoded biological molecules that contain highly repetitive 
subunit patterns (e.g. in the case of a nucleic acid, a high concentration of AC repeats such as 
"ACACACACACAC"), the subunit selection can be designed to create an endpoint prior to 
the occurrence of a particular repeat density of the particular subunit or motif of summits, in 
this instant a repeat density is the number of occurrences of a subunit or subunit motif per 
1 0 character string length measured in subunit number or lengths of the subunit motif 
respectively. 

Thus, in the example 5U ggested above, the substring can he selected such that 
the substring endpoint occurs adjacent to a character string domain in which the AC motif 
occurs at a frequency over 0.5 (50%) over a length of at least e.g. 4 motif lengths (in this 

15 case 8 subunit lengths). 

An other example, of such a selection is a substring selection based on the 
occurrence of a particular subunit at an occurrence of 100% over at least X summits. Thus, 
for example, where the encoded biological molecule is a nucleic acid and the subunit is 
adenosine "A", the frequency-biased selection may set a substring endpoint at the occurrence 

20 of a polyadenylation signal (e.g., AAAAAAA). Depending on the design of the frequency- 
biased substring selection criterion, equivalent results may be obtained using a motif-based 
selection scheme as described above. 

6. Other .criteria. 

Numerous other criteria can be used to influence and/or determine the 
25 selection of particular substrings. Such criteria include the predicted hybrophobicity and/or 
PI and/or PK of the molecule encoded by the substring. Other criteria include the cross-over 
number the desired fragment size, the substring length distribution, and/or rational 
information regarding the folding of the molecule(s) encoded by the substring®. 

IV. Concatenating substrings, 

30 Once populations of substrings are selected from the initial strings, the 

substrings are concatenated to produce new strings of approximately or exactly the same 
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length as the parent initial strings. The string concatenation can be performed according to a 
wide number of methods. 

In one embodiment, the substrings are randomly concatenated to produce 
"recomhined" strings. In one approach to such "random" concatenation, each substring is 
5 assigned a unique identifier (e.g. an integer or other identifier). The identifiers are then 
randomly selected from the pool (e.g. using a random number generator) and the 
subsequences corresponding to those identifiers are joined to produce a concatenated 
sequence. When joined subsequences are approximately ore exactly the length of the 
starting character string(s), the process is started anew to produce another string. The 

1 0 process is repeated until all of the substrings are utilized. Alternatively the substrings can be 
selected without withdrawing them from the "substring pool" and the process is repeated 
until a desired number of "full-length" strings are obtained. 

In preferred embodiments, however, it is desired to maintain the relative order 
of substrings farming the concatenated strings as existed in the initial strings. This can be 

15 accomplished by any of a wide number of means. For example, each substring selected from 
a parent string can be "tagged" with an identifier (e.g. a pointer) identifying the position in 
the initial string of that substring relative to the position of the other substrings derived from 
that parent string. Substrings derived from corresponding positions in other initial strings are 
assigned similar positional identifiers. This approach is illustrated in Figure 2 where three 

20 initial strings (designated A, B, and C) each give rise to five substrings numbered i through 
5. Each substring can be uniquely identified (e.g., Al, A2, . . . A5, Bl , B2, . . . BS, Ci, C2, . 
. . CS) as illustrated. A concatenated string can then be produced by randomly selecting a 
substring from pool 1 (consisting of Al, Bl , and C2), a substring from pool 2 (consisting of 
A2, B2, 02) and so on though pool 5. This process can be repeated until three strings are 

25 reconstructed. 

in this concatenation scheme, once a substring is concatenated it is removed 
from the substring pool. However, the concatenation can be accomplished by "copying" the 
subsequence from the pool and thus utilizing it in a concatenated sequence while still 
retaining the substring availability for subsequent concatenations. This permits greater 
30 diversity to be generated. 

In other embodiments, various alignment and/or similarity algorithms can be 
used to generally maintain the relative sequence of the substrings during the concatenation. 
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in this ppi ibsequ • m * tion in {he concatenated sequence 

by associating regions of high similarity (see, e.g., Figure 3). 

in preferred embodiments, the initial encoded biological molecules bear some 
relationship with each other. Thus, for example, where the encoded molecules represent 
5 members in a particular enzyme family, molecules represent individuals from a particular 
population, etc. The subsequences are expected to share domains of significant similarity, 
in addition, critical functional domains will tend to be conserved and therefore also increase 
the similarity of particular domains of" the subsequences. Thus, aligning regions of high 
similarity between subsequences will tend to reconstruct the relative order of the 

10 subsequences to reflect their order in the initial strings. 

it will not required that perfect order be established in every concatenated 
character string. That a percentage (e.g. preferably at least 1 percent, more preferably at 
least 10 percent, still more preferably at least 20% and most preferably at least 40 percent, at 
least 60% or at least 80 percent) of the concatenated sequences preserve the original order is 

1 5 preferred. 

The use of similarity measures to re-order the subsequences is similar to 
sequencing by hybridization (SBH) methodologies in which similarity algorithms are used to 
reconstruct nucleic acid sequences from fragments of the complete sequence (see, e.g., 
Barinaga (1991) Scimce, 253: 1489; Bains (1992) Bio/Technology 10: 757-758; Drmanac 

20 and Crkvenjako v, Yugoslav Patent Application #570/8 7, 1 987; Drmanac ei at ( 1 989) 
Genomics, 4; 1. 14; Strezoska et at. (1991) Proc. Natl Acad. Sci. USA 88; .10089; and 
Drmanac and Crkvenjakov, U.S. Fat. No. 5,202,231). 

It will be appreciated that certain concatenations alone, or selection and 
concatenation operations together can be represented by particular operators. Certain 

25 operators of this kind are known in genetics algorithms. Thus, for example, a "crossing 
over" (reciprocal translocation} operator can be defined in which subsequences at a similar 
position in two different initial sequences are exchanged. Similarly "linkage" operators can 
be defined that link particular subsequences in cross-over events so that the subsequences 
crossover together (whether or not they are adjacent subsequences). In view of the foregoing 

30 disclosure, other operators will be known to those of skill in the art. 
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V) Adding the produc t strings to a eoHeai on of strings. 

The concatenated strings produced by the methods of this invention are added 
to a collection of strings that forms the "populated dataset". The strings in this collection can 
be used as initial strings in further iterations of the methods described herein (see, Figure 1). 
5 The addition, in this context refers to a process of identifying one or more strings as included 
within a set of str ings. This can be accomplished by a variety of means including, but not 
limited to copying or moving the scring(s) in question into a data structure that is a collection 
of strings, setting or providing a pointer from toe string to a data structure that represents a 
collection of strings, setting a ftag associated with the string indicating its inclusion in a 
] 0 particular set, or simply designating a rule that the string(s) so produced are included in the 
collection. 

Once one or more concatenated character strings are generated, a selection 
criterion can optionally be imposed to determine whether or not the concatenated strings are 
to be included in the collection of strings (e.g. as initial strings for a second iteration and/or 
15 as elements of the populated datastructure), A wide number of selection criteria can be 
utilized. 

In one embodiment, a similarity index can be used as a selection criterion. 

Thus newly generated concatenated character strings must share a particular predefmined 

similarity (e.g. greater than 10%, preferably greater than 20% or 30%, more preferably 
20 greater than 40% or 50% and most preferably greater than 60%, 70%, 80%, or even 90%) 

with each other and/or with the initial strings (or the encoded molecules) and/or with a one or 

more "reference" strings. 

Selection can also involve the use of algorithms that evaluate "reiatedness" 

even when sequence identity is quite low. Such methods include "threading" algorithms 
25 md/of covariance measures, 

Other selection criteria can require that, the moieculc(s) represented by the 

concatenated strings meet certain computationally predicted properties. Thus, for example 

selection criteria could require a minimum or rn is inn m mol 11 r h ui 

minimum or maximum free energy in a particular buffer system, a minimum or maximum 
30 contact surface with a particular target molecule or surface, a particular net charge in a 

certain butter system, a predicted PK, PI, binding avidity, particular secondary or tertiary 

forms, ere 
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Still other sek ti ■ . eria can require that the tnoleciile<s) represented by the 
concatenated strings meet certain empirical physically assayed properties. Thus, for 
example, selection criteria could require that the molecule represented by the concatenated 
string have a certain temperature stability, level of enzymatic activity, produce a solution of a 
5 particular pH, have a particular temperature, and/or pH optima, have a minimum or 

maximum solubility in a particular solvent system, bind a target molecule with a minimum 
or maximum affinity, and so forth. The physical determination of particular selection criteria 
typically requires that the moiecule(s) represented by the concatenated string(s) be 
synthesized (e.g. chemically or by recombinant methods) or isolated. 

J 0 The application of such selection criteria in physical systems is known to 

those of ski! i in the art (see, e.g., Stemmer et aL, (1 999) Tumor Targeting 4:1-4; Ness ei al. 
(1999) Nature Biotechnology 17: 893-896: Chang et al (1999) Nature Biotechnology 1.7: 
793-797; Minshuil and Stemmer (1999) Current Opinion in Chemical Biology 3: 284-290; 
Christians et aL (1999) Nature Biotechnology; 1 7: 259-264; Crameri et al. (1998) Nature 

15 39 1 : 288-29 1 ; Crameri et al ( 1 997) Nature Biotechnology 1 5: 436-438; Zhang et al ( I 997) 
Proc Natl Acad, Sci, USA, 94: 4504-4509; Patten eta!. (J 99?) Curr, Opin, Biotech. 8: 724- 
733; Crameri et. al. (1996) Nature Med. 2:100-103; Crameri etal (1996) Nature 
Biotechnology 14: 315-319; Gates etal (1996) J. Mo!. Biol. 255:373-386; Stemmer (1996) 
Crameri and Stemmer (1995) BioTechnkmes 18: 194495; U.S. Patents 5,605,793, 5,81 1,238 

20 5,830,72 1 , 5,834,252, 5,837,458, WO 95/22625, WO 97/0078, WO 97/35966, WO 

99/41402; WO 99/4.1383, WO 99/41369, WO 9941368, EP 0934999; EP 0932670; WO 
9923107; WO 9921979; WO 9831837; WO 9827230, and W09S13487). 

VI. Introduction of additional variation. 

In certain instances it is desired to introduce additional variation into the 
25 population, This is particularly desired where repeated iterations of an evolutionary 

algorithm using the initial population generated by the methods of this invention does not 
provide a solution to the modeled problem (e.g. no member meets a selection criterion). 

Many methods can be used to introduce variation into the string population 
generated according to the methods of this invention. It is noted that variation can be 
30 introduced into the initial string(s) (input to the method) or into the concatenated string(s) 
(output). Preferably such variation will be introduced prior to a selection step, however in 
certain cases, variation may be introduced after selection {e.g. before a second iteration). 
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In one approach, a stochastic operator is introduced into the algorithm that 
randomly/haphazardly alters the one or more subunits comprising an encoded molecule. It is 
noted that variation can be introduced into the unencoded molecule (which is then re- 
encoded into a character string) and/or the variation can be introduced directly into the 
5 encoded character string. The stochastic operator typical!) im okes two select on pro< vses 
One selection process involves the determination of which subunit(s) to alter, while other 
selection process in volves a selection/determination of what the. subunit(s) are to be altered 
into. Both selection processes can be stochastic or alternatively on selection process or the 
other can be determinant. Thus, for example, the selection of the subunit(s) to "mutate" can 
3 0 be random/haphazard, but the mutation can always be into the same new/replacement 

subunit. Alternatively, the particular subunits that are to be mutated can be pre-determined, 
bu t the selection of the mutated/resultant subunit can be random/haphazard. Still in another 
embodiment, both the selection of the subunit to mutate and the result of the mutation can be 
random/haphazard. 

1 5 hi preferred embodiments, the stochastic operator will also take as an input or 

parameter a "mutation frequency" that sets the average frequency of occurrence of a 
"mutation", Thus, for example, where the mutation frequency is set at 10%, the stochastic 
operator will only permit a mutation in one out of lf> sub nits a mprising in the initial 
strings. The mutation frequency can also be set as a range (e.g. 5%«I0%> etc.). 

20 The "stochastic operator" need not be applied to every initial string nor to 

every substring comprising an initial string, Thus, in certain embodiments, the action of the 
stochastic operator will be constrained to particular initial strings and/or to particular 
substrings (e.g. domains) of one or more initial strings. 

Where both selection criteria of the stochast ic operator are fixed, the operator 

25 is no longer stochastic, but rather introduces a "directed mutation". Such an operator may- 
direct that every subunit "A" that the operator encounters is changed into a subunit "B". The 
directed mutation operator can still take a mutation frequency as a parameter/attribute/input. 
As described above, the mutation frequency will limit the number of "encountered" subunits 
that the operator actually transforms. 

30 It will also be a| I ic operator, as described above, can 

alter more than a single encoded subunit. In certain embodiments, the operator alters 
multiple encoded subunits or even entire substrings/domains. 
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Variation can also be introduced by the use of insertion or deletion operators. 
Insertion or deletion operators are essentially variants of "stochastic mutation" operators, 
Instead of transforming one or more subunits, a deletion operator removes one or more 
subunits, whi 1 mot subumts \.gain deletion and 

5 insertion operators have two selection processes; One process that selects the site of the 

insertion or deletion and another process that selects the size of the deletion or the identity of 
the insertion. One or both selection processes can be stochastic. Where both selection 
processes are predetermined (non-stochastic) the insertion or deletion operators ate directed 
insertion or directed deletion operators. As with the stochastic operator, the insertion or 

1 0 deletion operators can take a mutation frequency as a parumeter/atiribute/mput. 

In another embodiment variation can he increased by adding one or more 
initial strings that are randomly or haphazardly generated and bear no necessary relationship 
to the initial strings derived from biological molecule(s). The variation-introducing initial 
strmg(s) can be produced as a strictly random or haphazard string or, in certain 

15 embodiments, the variation string(s) are produced according to certain predetermined criteria 
(e.g. frequency of occurrence of particular subunits, minimum and ; or maximum degree of 
similarity with the encoded strings, etc.). The variation-introducing initial strings need not 
be full-length strings, but can also simply include one or more substrings. It will be noted 
that strings or substrings of this nature can be used to reduce varia tion as well Thus, where 

20 a particular molecular domain is "favored" strings or substring^) encoding this domain can 
be added to the population of initial strings. 

yil. Populating a data structure. 

In one embodiment, ail the concatenated string(s) produced by the methods of 
this invention are used to populate a data structure and/or are used as initial strings in another 

25 iteration of the methods described herein. In other embodiments, selection criteria are 

imposed as described above, and only concatenated strings meeting the selection criteria are 
used as initial strings and/or are used to populate a data structure. The data structure can be 
populated with the concatenated representation of the encoded moiecule(s) used in the 
above-described manipulations, or alternatively, the concatenated strings can be partially 

30 deconvolved to reproduce as simpler encoded or direct representation of the encoded 
biological molecules and these deconvolved strings can be used to populate the data 
structure. 
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In one embodiment, the data structure can be as simple as a piece of paper 
having the concatenated strings written out on it or a collection of cards each card listing one 
or more of the concatenated strings. In a preferred embodiment, the data structure is 
embodied i edia hank u i nd/or opti< itum and/oi 

5 magnetic and/or elect! \ i < ermit manipulation of the data structure by an appropriately 
designed computer, in particularly preferred embodiments, the data structure is formed in 
computer memory (e.g., dynamic, static, read-only, etc ) and/or in optical, magnetic, or 
magneto-optical storage media. 

The data structure, even in a computer accessible form, can simply provide a 

10 list of the concatenated strings. Alternatively, the data structure can be structured to preserve 
relationships between the various "entries". At a simple level this can entail maintaining a 
simple identity and/or order of entries. More sophisticated data structures are also available 
and may provide ancillary structures for indexing and/or sorting and/or maintaining 
relationships between one or more entries in the data structure (e.g., concatenated strings). 

15 The data structure can additionally contain annotations regarding the entry (e.g. origin, type, 
physical properties, etc.), or links between an entry and an external data source. Preferred 
data structures include, but are not limited to lists, linked lists, tables, hash tables and other 
indexes, Sat- file databases, relational databases, local or distributed computation systems. In 
particularly preferred embodiments, the data structure is a data file stored on conventional 

20 (e.g. magnetic and/or optical) media or read into a computer memory. 

VIII. Embod iment In a Programmed Digital Apparatus 

The invention may be embodied in a fixed media or transmissible program 
component containing iogic instructions and/or data that when loaded into an appropriately 
configured computing device cause that device to populate a data structure {e.g. generate a 

25 pool/collection of concatenated strings) according to the methods of this invention. 

Figure 4 shows digital device 700 that may be understood as a logical 
apparatus that can read instructions from media 717 and/or network port 719. Apparatus 700 
can thereafter use those instructions to direct a encoding of biological molecules 
manipulation of the encoded representation(s) of the molecules and population of a data 

30 structure, One type of logical apparatus that may embody the invention is a computer system 
as illustrated in 700, containing CPU 707, optional input devices 709 and 71 1 , disk drives 
715 and optional monitor 705. Fixed media 717 may be used to program such a system and 
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could represent a disk-type optica! or magnetic media or a memory. Conununication port 
719 may also be used to program such a system and could represent any type of 
communication connection. 

The invention also may be embodied * ihry of > ti< 

5 specific integrated circuit (ASIC) or a programmable logic device (PLD). in such a case, the 
invention may be embodied in a computer understandable descriptor language which may be 
used to create an ASIC or PLD that operates as herein described. 

The invention also may be embodied within the circuitry or logic processes of 
other digital apparatus, such as cameras, displays, image editing equipment, etc, 

i0 IX. Embodiment in a web site. 

The methods of this invention can be implemented in a localized or 
distributed computing environment. In a distributed environment, the methods may 
implemented on a single computer comprising multiple processors or on a multiplicity of 
computers. The computers can be linked, e.g. through a common bus, but more preferably 

15 die coraputer(s) are nodes on a network. The network can be a generalized or a dedicated 
local or wide-area network and, in certain preferred embodiments, the computers may be 
components of an intra-net or an internet 

In a preferred internet embodiment, a client system typically executes a Web 
browser and is coupled to a server computer executing a Web server. The Web browser is 

20 typically a program such as IBM's Web Explorer, or NetScape or Mosaic. The Web server is 
typically, but not necessarily, a program such as IBM's HTTP Daemon or other WWW 
daemon. The client computer is bi-directionally coupled with the server computer over a 
line or via a wireless system. In turn, the server computer is bi-directionally coupled with a 
website (server hosting the website) providing access to software implementing the methods 

25 of this invention. 

A user of a client connected to the Intranet or Internet may cause the client to 
request resources that are part of the web site(s) hosting the appKcaf ton(s) providing an 
implementation of the methods of this invention. Server program(s) then process the request 
to return the specified resources (assuming they are currently available). A standard naming 

30 convention has been adopted, known as a Uniform Resource Locator ("URL"), This 
convention encompasses several types of location names, presently including subclasses 
such as Hypertext Transport Protocol ("http"). File Transport Protocol ("tip"), gopher, and 
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Wide Area Information Service ("WAIS"), When a resource is downloaded, it may include 
the URLs of additional resources. Thus, the user of the client can easily learn of the existence 
of new resources that he or she had not specifically requested. 

The software implementing the mcthod(s) of this invention can ran locally on 
5 the server hosting the website in a true client-server architecture. Thus, the client computer 
posts requests to the host server which runs the requested process(es) locally and then 
downloads the results back to the client. Alternatively, the methods of this invention can be 
implemented in a "multi-tier*' format wherein a component of the method(s) are performed 
locally by the client. This can be implemented by software downloaded from the server on 

1 0 request by the el lent (e.g. a Java application) or it can be implemented by software 
"permanently" installed on the client. 

In one embodiment the application(s) implementing the methods of this 
invention are divided into frames. In this paradigm, it is helpful to view an application not 
so much as a collection of features or functionality but, instead, as a collection of discrete 

1 5 frames or views. A typical application, for instance, generally includes a set of menu items , 
each of with invokes a particular frame-that is, a form which manifest certain functionality 
of the application. With this perspective, an application is viewed not. as a monolithic body 
of code but as a collection of applets, or bundles of functionality, In this manner from within 
a browser, a user would select a Web page link which would, in turn, invoke a particular 

20 frame of the application (i.e., subapplication). Thus, for example, one or more frames may 
provide functionality for inputing and/or encoding biological molecule(s) into one. or more 
character strings, while another frame provides tools for generating and/or increasing 
diversity of the encoded character siring(s). 

In addition to expressing an application as a collection of frames, an 

25 application is also expressed as a location on the Intranet and/or Internet; a URL (Universal 
Resource Locator) address pointing the application. Each URL preferably includes two 
characteristics; content data for the URL (i.e., whatever data is stored on the server) together 
with a data type or MIME (Multipurpose Internet Mail Extension) type. The data type 
allows a Web browser to determine how it ' I < ver (e.g., 

30 such as interpreting a .gif file as a bitmap image). In effect, this serves as a description of 

what to do with the data once it is received at the browser, if a stream of binary data is 

received as type HTML, the browser renders it as an HTML page. If instead it is received 

type bitmap, on the other hand, the browser renders it as a bitmap image, and so forth. 
-32- 
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In Mki i> in lo i r iercnt techniques exist for allowing a host 
application to register an interest in a data object (ie... data of a particular type). One 
technique is for the application to register with Windows an interest in a particular file 
extension for an (e.g., .doc— "Microsoft Word Document"); this is the most common 
5 'technique employed by Window applications. Another approach, employed in Microsoft 
Object Linking and Embedded (OLE), is the use of a class Globally Unique Identifier or 
GUID-a 16-byte identifier for indicating a particular server application to invoke (for 
hosting the document having the GUID). The class ID is registered on a particular machine 
as being connected to a particular DLL (Dynamic Link Library) or application server, 

1 0 In one embodiment of particular interest, a technique for associating a host 

application with a document is through a use of MIME types. MIME provides a. 
standardized technique for packaging a document object. It includes a MIME header for 
indicating which application it: appropriate for hosting the document, all contained in a 
format suitable for transmission across the Internet. 

1 5 In one preferred embodiment, the methods of the present invention are 

implemented, in part, with the use of a MIME type specific to the use of the methods of this 
invention. The MIME type contains information necessary to create a document (e.g., 
Microsoft ActiveX Document) locally but, in addition, also includes information necessary 
to find and download the program code for rendering the view of the document, if necessary. 

20 If the program code is already present locally, it need only be downloaded for purpose of 
updating the local copy. This defines a new document type which includes information 
supporting downloadable program code for rendering a view of the document. 

The MIME type may be associated with a file extension of AFP. A file with 
the .APP extension is an OLE Document, implemented by an OLE DocObject. Because the 

25 APP file is a file, it can be placed on a server and linked to using an HTML HREF. The 
APP file preferably contains the following pieces of data: (i) the CLSID of an ActiveX 
object, which is an OLE Document Viewer implemented as one or more forms appropriate to 
the use of the methods of this invention; (2) the URL of the codebase where the object's code 
can be found, and (3) (optionally) a requested version number. Once the .APP DocObject 

30 handler code is installed and registers the APP MIME type, it can be used to download an 
. APP file into the user's Web browser. 

On the server side, since the .APP file is really a file, the Web server simply 
receives the request and returns the file to the client. When the APP file is downloaded, the 
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! '.' D v 1 t hand! ; hi op ratin stet wnload the ?as 1 the obje 
specified in the ,APP file. This system functionality is available in Windows through the 
CoGetClassObjectFromURL function. After the ActiveX object's codebase is downloaded, 
the ,APP DocObject handler asks the browser to create a view on itself, for instance, by 
5 calling the ActivateMe method on the Explorer document site. The Internet Explorer then 
calls the DocObject back to instantiate a view, which it does by creati ng an instance of the 
ActiveX view object from the code that was downloaded. Once created, the ActiveX view 
object gets in-place activated in the Internet Explorer, which creates the appropriate form and 
all its child controls. 

10 Once the form is created, it can establish connections back to any remote 

server objects it needs to perform its functions. At this point, the user can interact with the 
form, which will appear embedded in the Internet Explorer frame. When the user changes to 
a different page, the browser assumes responsibility for eventually closing and destroying the 
form (and relinquishing any outstanding connections to the remote servers). 

15 In one preferred embodiment, from an end- user's desktop, the entry point to 

the system is die corporate home or the home page of another particular web-site. The page 
can, optionally, include, in a conventional manner, a number of links. In response to the user 
clicking on a particular link to an application page (eg. a page providing the functionality of 
the methods of this invention), the web browser connects to the application page (file) 

20 residing on the server. 

In one embodiment, where the user requests access to the methods of this 
invention, the user is directed to a particular page type, e.g., an application (appdoc) page for 
in-place execution of an application (implementing one or more elements of the methods of 
this invention) in the Web browser. Since each application page is located using an URL, 

25 other pages can have hyperlinks to it. Multiple application pages can be grouped together by 
making a catalog page that contains hyperlinks to the application pages. When the user- 
selects a hyperlink that points to to an application page, the Web browser downloads the 
application code and executes the page inside the browser 

1 1 + i i cr d * r h lin f i > hi on pa< t c 1 er (based on 

30 the defined MIME type) invokes a local handier, a handler for documents of a type, ore 
particularly, the application page preferably includes a Globally Unique Identifier (GUfD) 
and a codebase URL for identifying a remote (download^ I jpli afion to invoke for 
hosting the document. Given the document object and the GUiD which arrive with the 
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rpplication \ 1 ndlei looks to the elk it <i achine to see if the hosting 

application already resides locally (e.g., by examining Windows 95/NT registry). At this 
point the local handier can choose to invoke a local copy (if any) or download the latest 
version of the host application. 
5 Different models of downloading code are commonly available. When code 

is downloaded, a "code base" specification (file) is initially requested from the server. The 
code base itself can range from a simple DLL file to a Cabinet fi le (M icrosoft .cab file) 
containing multiple compressed files. Still further, an information (e.g., Microsoft .inf) file 
can be employed for instructing the client system how to install the downloaded application. 

10 These mechanisms afford great flexibility in choosing which component of an application 
gets downloaded and when. 

For preferred embodiments, the machinery employed for actually 
downloading program code itself relies on standard Microsoft ActiveX API (Application 
Programming Interface)-calls. Although the ActiveX API does not provide native support 

15 for Web-delivered applications, its API can be invoked for locating the correct version of the 
program code, copying it to the local machine, verifying its integrity, and registering it with 
the clients operating system. Once the code has been downloaded, the handler can proceed 
to invoke the now-present application host for rendering the document object (in a manner 
similar to invoking the hosting application through the registry if it were already installed). 

20 Now that the hosting application (OLE server) is loaded at the client, the 

client system can employ the OLE document view architecture to render the application 
correctly within the browser, including using conventional OLE methodology for adding the 
application's menu to that of the browser and for correctly re-sizing the application upon a 
re-size of the browser (as oppose to requiring the application to execute within a single 

25 Active X control rectangle-the limitation previously noted). Once the application js 

executing at the client, it can execute remote logic such as using RFC (Remote Procedure 
Call) methodology. In this manner logic which is preferably implemented as remote 
procedure(s) can still be used. 

In particular preferred embodiments, the methods of this invention are 

30 implemented as one or more frames providing the following functionality. Function^) to 
encode two or more a biological molecules into character strings to provide a collection of 
two or more different initial character strings wherein each of said biological molecules 
comprises at least about 10 subumts; functions to select at least two substrings from the 
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character strit si > tie tit i s to form one or more product strings 

about the same length as one or more of the initial character strings; and functions to add 
(place) the product strings to a collection of strings. ' 

Fhe functions to encode t « ■ 1 

5 one or more windows wherein the user can insert representation^) of biological molecules. 
In addition, the encoding function also, optionally, provides access to private and/or public 
databases accessible through a local network and/or the intranet whereby one or more 
sequences contained in the databases can be input into the methods of this invention. Thus, 
for example, in one embodiment, where the end user inputs a nucleic acid sequenced into the 

1 0 encoding function, the user can, optionally, have the ability to request a search of GenBarik 
and input one or more of the sequences returned by such a search into the encoding and/or 
diversity generating function. 

Methods of implementing Intranet and/or Intranet embodiments of 
computational and/or data access processes are well known io those of skill in the art and are 

15 documentede in great detail (see, e.g., Cluer ei al (1992) A General Framework/or the 
Optimization of Object-Oriented Queries, Proc SIGMOD International Conference on 
Management of Data, San Diego, California, Jun, 2-5, 1992, SIGMOD Record, vol 21, 
Issue 2, Jun., 1992; Stonebraker, M., Editor; ACM Press, pp. 383-392; ISO-ANSI, Working 
Draft, "Information Technology-Database Language SQL", Jim Melton, Editor. International 

20 Organization for Standardization and American National Standards Institute, Jul. 1 992; 

Microsoft Corporation, "ODBC 2.0 Programmer's Reference and SDK Guide. The Microsoft 
Open Database Standard for Microsoft Windows.TM. and Windows NT.TM,, Microsoft 
Open Database Connectivity.™. Software Development Kit", 1992, 1993, 1994 Microsoft 
Press, pp, 3-30 and 41-56; ISO Working Draft, "Database Language SQL-Part 2:Foundation 

25 (SQL/Foundation)", CD9075-2: 199.ehi.SQL, Sep. 1 1 , 1997, and the like). 

Those skilled in the an will recognize many modifications may be made to 
this configuration without departing from the scope of the present invention, For example, in 
a two-tier configuration, the server system executing the functions of the WWW gateway 
may also execute the functions of the Web server. For example, any one of the above 

30 described embodiments could be modified to accept requests from users/user terminals that 
are in a format other than a URL. Yet another modification would involve the adaptation to 
a multi-manager environment. 
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X. ::: .. : In.<^rpQr : ati^.g. .a. physical evaluation a»d feedback. loop, 

As indicated above i ce ain prefc i * 1 cr eria 

can require that the moiec«ie<s) represented by the concatenated strings meet certain 
empirical physically assayed properties. To assay these properties it is necessary to obtain 
5 the encoded molecules. To accomplish this, the molecule(s) represented by the 
concatenated siring(s) are physically synthesized (e.g. chemically or by recombinant 
methods) or isolated. 

Physical synthesis of genes, proteins, polysaccharides encoded by the 
collection(s) of character strings produced according to the present invention is the primary 
10 means to create a physical representation of matter thai is amenable to a physical assay for 
one or more desired properties. 

in a preferred embodiment, gene synthesis technology is used, typically, to 
construct libraries in a consistent manner and in close adherence to the sequence 
representations provided in the collection of concatenated strings produced by the methods 
15 of this invention. 

Preferred gene synthesis methods allow fast construction of libraries of 10 4 - 
1 0* "gene/protein" variation. This is typically adequate for screening/selection protocols as 
larger libraries are more, difficult to make and maintain and sometimes cannot be as 
completely sampled by a physical assay or selection methods. For example, existing 
20 physical assay methods in the art (including, e.g., "life-and-death" selection methods) 

generally allow sampling of about lif variations or Jess by a particular screen of a particular 
library, and many assay are limited to sampling about 10 4 -10 3 members. Thus, building 
several smaller libraries is a preferred method as large libraries cannot easily be completely 
sampled. Larger libraries, however, can also be made and sampled, e.g.. using high- 
25 throughput methods. 

There are many methods which can be used to syn izt t 
polysaccharides, proteins, etc. with well-defined sequences and the area is quickly 
developing. Solely, for the purpose of clarity of illustration, this discussion will focus on one 
of the many possible and available types of known methods for the production of biological 
30 molecules. 

Current art in the polynucleotide synthesis is best represented by well-known 
and mature phosphoramidite chemistry which allows one of skill to effectively prepare 
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i i ; for routine 

synthesis of oligonucleotides signi ficantly longer than 100 bp and the synthetic yield 
decreases and the degree of purification required increases. Oligonucleotides of a "typical" 
40-80 bp size can be obtained routinely ami directly with very high purity, 
5 It is noted that oligonucleotides and even complete synthetic (double franc ed 

or single stranded) genes can be ordered from any of a number of commercial sources such 
as The Midland Certified Reagent Company (mcrc@oligos.com). The Great American Gene 
Company (http:/Avw.genco.com), ExpressGen, inc. (www.expressgen.com) Gperon 
Technologies Inc. (alameda, CA), and many others. Similarly, peptides can be custom 

10 ordered from any of a variety of sources such as PeptidoGenic (pkim@ccnet.com), HT1 Bio- 
pra=ducts, Inc. (http:// www.htibio.com), BMA Biomedicals, Ltd. (U.K., Bio-Synthesis, 
Inc., and many others. 

A relevant demonstration of total gene synthesis from small fragments which 
is readily amendable to optimization, parallelism, and high throughput is set fort!) by Dillon 

15 and Rosen ( 1 990) Biotechniques, 9(3): 298-300. A simple and rapid PCR-based assembly 
process of a gene from a set of partially overlapping single-strand oligonucleotides without 
the use of ligase is described. Several groups have also described successful application of 
variations of the same PCR-based gene assembly approach to the synthesis of various genes 
of increasing size, thus demonstrating the methods general applicability and combinatorial 

20 nature for synthesis of libraries of mutated genes (for useful references see also, Sandhu et 
al (1992) Bioteahniques, 12(1): 15-16, Prodomouand Pearl (1992) Protein Engirt., 5(8): 
827-829, Chen et al (1994) J ACS, \ 394(1 1): 8799-8800, Hayashi et al (1994) 
Biotechniques, 17: 310-314, and others). 

More recently Stemmer et al. (1995) Gene 1645: 49-53, provided evidence 

25 tha t PCR-based assembly methods are useful to build larger genes of up to at least 2.7 kb 
from dozens or even hundreds of synthetic 40 bp oligonucleotides. These authors also 
demonstrated that, from the four steps comprising the known PCR-based gene synthesis 
protocol (oligonucleotide synthesis, gene assembly, gene amplification, and typically, 
cloning) the gene amplification step can be omitted if a "circular "assembly PCR is used. 

30 Once prepared, the gene(s) can be inserted into vectors and the vectors used to 

rrcmsfect host cells and express the encoded protein(s) according to routine methods well 

known to those of skill in the art. Cloning methodologies to accomplish these ends, and 

sequencing methods to verify the sequence of nucleic acids are well known in the art. 
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Examples of apprc i g techniques, and instructions sufficient to 

direct persons of skill through many cloning exercises are found in Berger and Kimmel, 
Guide to Molecular Cloning Techniques, Method:; in Enzvmology Vol. 1 52 Academic Press, 
Inc., San Diego, CA (Berger); Sarnbrook eial (1989) Molecular Cloning _ A Laboratory 
5 Manual (2nd ed.) Vol. 1 -3 , Cold Spring Harbor Laboratory, Cold Spring Harbor Press, NY; 
and Current Protocols in Molecular Biology, P.M. Ausubel et aL eds., Current Protocols, a 
joint venture between Greene Publishing Associates, Inc. and John Wiley & Sons, Inc., 
(1994 Supplement). Product information from manufacturers of biological reagents and 
experimental equipment also provide information useful in known biological methods. Such 

1 0 manufacturers include the SIGMA chemical company (Saint Louis, MO), R&D systems 
(Minneapolis, MN), Pharmacia LKB Biotechnology (Piscataway, NJ), CLONTECH 
Laboratories, Inc. (Palo Alto, CA), Cheni Genes Corp., AJdrich Chemical Company 
(Milwaukee, WI), Gien Research, Inc., GIBCO BRL Life Technologies, Inc. (Gaithersberg, 
MD), Fluka Chemica Biocheraika Anaiytika (Fluka Chemie AG, Buehs, Switzerland), 

15 Invitrogen, San Diego, CA, and Applied Biosystems (Foster City, CA), as well as many 
other commercial sources known to one of skill. 

The physical molecules, once expressed can be screened for one or more 
properties and it can be determined whether or not they meet the selection criteria. The 
character strings encoding molecules meeting the physical selection criteria are then selected 

20 as described above. Numerous assays for physical properties (e.g. binding specificity and/or 
avidity, enzymatic activity, molecular weight, charge, thermal stability, temperature optima, 
pH optima, etc.) are well known to those of skill in the art. 

In certain embodiments, the physical molecules can be subject to one or more 
"shuffling" procedures and optionally screened for particular physical properties, to generate 

25 new molecules which can then be encoded and processed according to the methods described 
above, 

A variety of "shuffling methods" are known, including those taught by the 
inventors and their coworkers, e.g. Stemmer, et al (1994) Nature 370; 389-391 , Stemmer 
(1994) Proc. Natl Acad ScL USA. 91: 10747-10751, Stemmer, U.S. Patent No: 5,603,793, 
30 Stemmer et al. U.S. Patent No: 5,830,721, Stemmer et al. U.S Patent No: 5,811,238, 

Mmshttll et al U.S. Patent No; 5,837,458, Crameri etal (1996) Nature Med., 2(1); 100-503, 
PCT Publications WO 95/22625, WO 97/20078, WO 96/33207, WO 97/33957, WO 
98/27230, WO 97/35966, WO 98.8 1837, WO 98/13487, WO 98/13485 and WO 98/42832. 
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In addition, several copending applications describe important DN A. f ffimt .neiaodologics 
{see, e.g., copending USSN 09/116,188, filed July 15, 1998, USSN 60/102,362, and 
Sefifonov and Stemmer Methods for making character strings, polynucleotides & 
polypeptides having desired characteristics filed 02/05/1999, USSN 60/1 .18,854). 
5 fa addition, the methods described above can also be practiced in a parallel 

mode where each of the individual library members, including a plurality of the genes, 
proteins, polysaccharides, etc. for subsequent physical screening are synthesized in spatially 
segregated vessels or arrays of vessels, or in a poolwise maimer where all, or part, of the 
desired plurality of molecules are synthesized in a single vessel Many other synthetic 

1 0 approaches are known and specific advantages of one versus another may readily be 
determined by one skilled in the art. 

The processes discussed herein arc amenable to production using high- 
throughput systems. High throughput (e.g. robotic) systems are commercially available (see, 
e.g., Zymark Corp., Hopkmton, MA; Air Technical Industries, Mentor, OH; Beckman 

15 Instruments, Inc. Fullerton, CA; Precision Systems, Inc., Natick, MA, etc.). These systems 
procedures inch npl 11 liqu 

dispensing, timed incubations, and final readings of the microplate in detector(s) appropriate 
for the assay. These configurable systems provide high throughput and rapid start up as 
well as a high degree of flexibility and customization. The manufacturers of such systems 

20 provide detailed protocols the various high throughput. Thus, for example, Zymark Corp. 
provides technical bulletins describing the use of high throughput systems for cloning 
expression and screening of chemically or recombinant! y produced products, 

XL Uses of the generated string populations). 

A) Use in ut-m-tk- evolutionary algorithms, 

25 in one embodiment the methods of this invention provide a population of 

character strings. Particularly preferred character strings represent encoded biological 
molecules and typically the encoded molecules bear some relationship to each other 
reflecting a level of biological organization. Consequently, the character strings produced by 
the methods of this invention do not reflect a random or haphazard selection from a uniform 

30 sequence, space, but rather capture degrees of relatedness for variation) reflective of that 

particular level of organization (e.g. gene, gene family, individual, subpopuiation, etc.) found 
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315 the natural world. The collections of character strings (e.g. populated data structure} 
produced by the methods of this invention thus provide a useful starting point for various 
evolutionary models and are convenient for use in evolutionary algorithms (evolutionary 
computing). 

When used in such models, the population^- (col 
produced by the methods of this invention provide far more information than evolutionary 
algorithms run on arbitrary populations. 

For example, where an evolutionary algorithm utilizes as a starting point, a 
population comprising a set of random or arbitrary members, the dynamics of the simulation 
reflect progression from the arbitrary starting point to a particular solution (e.g. distribution 
of properties in the resulting populations)). Since the starting point is arbitrary and 
essentially unrelated to a population produced by a natural process, these dynamics afford no 
information regarding the dynamics oi natural processes/populations. 

In contrast, the collections of character strings produces by the methods of 
this invention contain far more information than the randomly produced starting points used 
in conventional evolutionary algorithms. First, each member of population contains 
considerable information regarding molecular structure. Thus, one member is distinguished 
from another member not simply as "self/not-self (i.e. an allelic representation), but rather 
members are distinguished by degrees of reiatedness/similarity. Members of the populations 
produced by the methods of this invention will reflect varying degrees of covariation. 

In addition, because the populations produced by the methods of this 
invention reflect a fine structure characteristic of the level of biological organization encoded 
into the initial strings, the initial dynamics of a simulation run using these starting sets 
reflects the dynamics of "real world" populations and affords considerable insight into 
evolutionaiy processes. 

in addition, because specific molecules are represented by members generated 
using the methods of this invention, evolutionary algorithms ran using these data structures 
provides real information regarding molecular evolution and/or the design of new and useful 
molecular entities, 

B) Use in index gene ration. 

in another embodiment, the data stru f ve methods of this 

invention can be used as tags (indices) for indexing essentially any kind of information. IN 
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this approach, information of greater similarity is tag I ni ' iata Structure 

(charactet - I er similarity, while information of lower similarity is tagged 

with members of the data structure having lower similarity. In preferred embodiments, the 
similarity of the character strings used to tag two different pieces of data reflects (is 
5 proportional to) the similarity of the ts »g d inf< rmation. 

When a search is performed, an initial hit is identified using traditional scare it 
techniques. Then, when closely related information is desired, the data structure can be 
searched for similar members using any of the well known similarity algorithms described 
above. 'These similarity algorithms are designed to provide a thorough, rapid, and efficient 
1 0 search of an enormous data space. When members (indices) of desired similarity are 
identified, they will point to the tagged data thereby providing the end user with related 
information. 

C) Use as reference, objects in data base searches. 

In a related application, the data structures produced by the methods of this 
1 5 invention, or the members of such data structures (i.e., the character strings) can be used as 
reference objects in database searches. For example, initial known information (e.g. 
molecular structure, or index strings from a knowledge database as described above) is 
encoded and modified according to the methods described herein. This produces a new data 
structure that captures related, but non-obvious variants of the initial encoded information. 
20 The resulting information (e.g., members of the data structure) can be 

deconvolved to identify actual or theoretical molecule(s) and this can be used to search 
typical databases for the same or related molecules. Where the encoded information is from 
a database index, the member of the data structure can be used to probe the original or new 
database to identify relevant/related information. 

25 D) Identification of structu ral mot li s conferring , specific molecula r 

properties. 

It is often of interest to identify regions of a molecule (e.g. a protein) that may 
be responsible for specific properties, e.g. to facilitate functional manipulation. This is 
traditionally done using structural information, usually obtained by x-ray crystallography. 
30 The sequences of naturally occurring enzymes that catalyze similar or even 

identical reactions can vary widely; sequences may be only 50% identical or less, while a 
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' 1 ' v b enzymes ttal i n ! ; 5 1 ot e i >p a i ' 

enzymes may differ significantly. These include physical properties such as stability to 
temperature and organic solvents, pH optima, solubility, ability to retain activity when 
immobilized, ease ot expression in <iii t n < systems Thej also include catai>tic 
5 properties including activity (K ;at and K«), the range of substrates accepted, and even of 
chemistries performed. TOE methods described here can also be applied to non-catalytic 
proteins (e.g. Uganda such as cytokines) and even nucleic acid sequences (such as promoters 
that, may be inducible by a number of different Hgands), wherever multiple functional 
dimensions are encoded by a family of "homologous "sequences. 

10 Because of the divergence between enzymes with similar catalytic functions, 

it is not usually possible to correlate specific properties with individual amino acids at certain 
positions. There are just too many amino acid differences. However, libraries of variants 
can be prepared from family of homologous natural sequences by encoding members of the 
family into initial strings according to the methods of this invention, then selecting and 

1 5 concatenating substrings to populate a data structure with encoded variants. 

The encoded or deconvol ved variants can be tested in silico for desired 
properties and/or the encoded variants can be deconvolved, and the corresponding molecule 
physically synthesized as described above. The synthesized molecule can then be screened 
for one or more desired properties. 

20 If members of the data structure are tested under a specific set of conditions 

for a particular property, the optimal combinations of sequences from the data structure (or 
the initial string collection) for those conditions can be determined. If the assay conditions 
are altered in only one parameter, different individuals from the library {data structure) will 
be identified as the best performers. Because the screening conditions are very similar , most 

25 amino acids will probably be conserved between the two sets of best performers (the best 
performers in the initial string collection (set 1) and the best performers in the populated data 
structure (set 2)). Comparisons of the sequences oft best enzymes under the two different 
conditions will therefore identify the sequence differences responsible of the differences in 
performance, 

30 Principle component analysis (e.g. using Partek type software) is one of many 

mulli-variate tools useful for such an analysis. 
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E) Use in generating music. 

In still another embodiment the methods of this invention can be used to 
generate music . Using any of a number of well known programs, biological molecules (e.g. 
DNA, proteins, etc.) can be encoded into musical notes. This can involve mapping a 
5 particular subunit onto a particular note. The timing and/or timbre of the notes is determined 
by the motif and/or secondary structure in which the subunit occurs. 

Thus for example, the program SS-midi has been used to encode various 
nucleic acid and amino acid sequences into music, in one approach (DNA calypso, purines 
were played 3/2 the speed of pyrimidines, the bases C,T,G,A were mapped to the notes 
10 €,P s (j,A and the first strand was played with jazz organ, while the complementary strand 
with bass, In other approaches note duration can be longer when the note/snbunit is found in 
a helix then when it is found in a p-sheet. Other variants are, of course, possible. 

In the methods of this invention, the biological molecules are encoded into 
strings, the substrings selected and concatenated and the data structure populated as 
15 described above. The populated data structure is then used as input to a program (e.g., SS- 
midi) that maps the new sequences encoded in the data structure into music. The data 
structure can be iterattvely repopulated as described above thereby generating variants of the 
music; pin ses thus produced. 

F) Use in drivin%syfltfretic machinery. 

20 As indicated above, the data structures produced by the methods of this 

invention can be used to drive devices for the chemical synthesis of the encoded molecules 
(e.g. polypeptides, nucleic acids, polysaccharides, etc). Using only a lew initial sequences 
("seed members") the methods of this invention provide literally tens, hundreds, thousands, 
tens of thousands, hundreds of thousands, or even millions of different encoded molecules, 

25 When the resulting data structure, or members thereof, is used to drive a chemical (or 
recombinant) synthesis a "combinatorial" library of the desired molecules of v irtually any 
size can be prepared. Such "combinatorial" libraries are widely desired to provide systems 
for screening for therapeutics, industrial process molecules, particular enzymes, etc. 

30 EXAMPLES 
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The following t ample 3 are offered to illustrate, but not to limit the claimed 

invention. 

Example It Snbtilisin family model. 

Amino acid sequences were aligned. (Codon usage can be optimized on 
5 retrotranslalion for a preferred expression system, and n umber of oligonucleotides for 

synthesis can be minimized). A Dot plot pairwise alignment of all possible pairs of? parents 
was made (Fig. 5, 6, 7). Pair 6 and 7 showed 95% percent identity per each window of >7aa, 
while all other pairs showed 80% percent identity per each window of >?aa. Note that 
stringency of alignment (and subsequent representation of crossover between parents) can be 
10 manipulated individually for each, pair, so that low homology crossover can be represented at 
the expense of highly homologous parents. No structural biases or active site biases were 
incorporated in this model. 

Example :2; A process tor desi gn of crossover oligonucleotides fo r synthesis of 
chimerical i po iynucIcoUdes : 

15 First, substrings are identified and selected in parental (initial) strings for 

applying a crossover operator to from chimeric junctions. This is performed by: a) 
identifying all or part of the pairwise homology regions between all parental character 
strings, b) selecting ail or part of the identified pairwise homology regions for indexing at 
least one crossover point within each of the selected pairwise homology regions, c) selecting 

20 one or more of the pairwise non-homology regions for indexing at least one crossover point 
within each of the selected pairwise nonhomology regions ("c" is an optional step which can 
be omitted, and is also a step where structure -activity based elitism can be applied), thereby 
providing a description of a set of positionally and parent-indexed regions/areas (substrings) 
of parental character strings suitable for further selection of crossover points. 

25 Secondly, further selection of crossover points within each of the substrings 

of the set of the substrings selected in Part 1 is performed. The steps include: a) randomly 
selecting at least one of the crossover points in each of the selected substrings, and/or b) 
selecting at least one of the crossover points in each of the selected substrings, using one or 
more of annealing simulation-based models for determining probability of the crossover 

30 point selection within each of the selected substrings and/or c) selec ting one crossover point 
approximately in the middle of each of the selected substrings, thereby creating a set of 
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pairwise crossover points, where each point is indexed to corresponding character positions 
in each of the pare? n lesired to from a chimeric junction at that point. 

Thirdly, optional codon usage adjustments are performed. Depending on 
methods used to determine homology (strings encoding DNA or AA), the process can be 
5 varied. For example, if a DNA sequence was used: a) adjustment ofcodons for the selected 
expression system is performed for every parental siring, and b) adjustment ofcodons among 
parents can be performed to standardize codon usa t i c amino acid at every 
corresponding position. This process can significantly decrease total number of distinct 
oligonucleotides for gene library synthesis, arid may be particularly beneficial for cases 

10 where AA homology is higher than DNA homology, or with families of highly homologous 
genes (e.g. 80%+ identical). 

This option has to be exercised with caution, as it is in essence an expression 
of an elitism mutation operator. Thus, one considers the benefits of cutting the costs of 
oligonucleotides versus introduction of this bias, which can have undesirable consequences, 

15 Most typically, one uses codons which encode AA at a given position in a majority of 
parents. 

If AA sequences are used: a) retrotranslate sequence to degenerate DN A; b) 
define degenerate nucleotides using position-by-posttion referencing to codon usage m 
original DNA (of majority of parents or of corresponding parent), and/or - exercise codon 
20 adjustments suitable for the selected expression system where a physical assay will be 
performed. 

This step can also be used to introduce any restriction sites within coding 
parts of the genes, if any, for subsequent identification/QA/deconvolution/manipulations of 
library entries. All crossover points identified in Part 2 (indexed to pairs of parents) arc 
25 correspondingly indexed to the adjusted DNA sequences. 

Fourth, oligonucleotide arrangements are selected for a gene assembly 
scheme. This step includes several decision steps: 

Uniform 40-60 mer oligonucleotides are typically used (using longer 
oligonucleotides will result in decrease of the number of oligonucleotides to build parents, 
30 but uses additional dedicated oligonucleotides for providing representation of closely 
positioned ci os ovei n rations. 
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< <s i< shones or kinder digs 1 1 llowed (jU., a Yes/No? 

decision), A "Yes" decision cats the total number of oligonucleotides for high homology 
genes of different lengths with gaps (deletion'inse-rtion), especially for l-2aa). 

Select the overl \y 15 ises, which can be symmetrical or 

5 asymmetrical.) 

Select whether degenerate oligonucleotides are allowed (Yes/No?). Another 
potent cost cutting feature and also a powerful means to obtain additional sequence diversity. 
Partial degeneracy schemes and minimized degeneracy schemes are especially beneficial in 
building, mutagenic libraries. 

10 If software tools are used for these operations, several variations of the 

parameters are ran to select maximum library complexity and minimal cost. Exercising 
complex assembly schemes using oligonucleotides of various length significantly 
complicates indexing processes and, subsequently, assembly of the library in positional!}' 
encoded parallel or partial pooling formats, if this is done without sophisticated software, a 

15 simple and uniform scheme (e.g. all oligonucleotides 40 bases long with 20 bases overlap) 
can be used. 

Fifth, "convenience sequences" are designed in front and in the back of the 
parent strings. Ideally, it is the same set which will be built in every library entry at the end. 
These include any restriction sites, primer sequences for assembled product identifications, 

20 RBS, leader peptides and other special or desirable features, in principle, the convenience 
sequences can be defined at a later stage, and at this stage, a "dummy" set of appropriate 
length can be used, e.g. a substring from an easily recognizable forbidden letters. 

in Part 6 an indexed matrix of oligonucleotide strings for building every 
parent is created, according to the selected scheme. An index of every oligonucleotide 

25 includes: a parent identifier (parentID), indication of coding or complementary chain, and 
position numbers. Crossover points are determined for indexed coding string of every parent 
with head and tail convenience substrings. A complementary chain of every string is 
generated. Every coding string is selected according to the selected assembly PGR scheme 
in part 4 (e.g. in increments of 40 bp). Ever/ complement string is split according to the 

30 same scheme (e.g. 40 bp with 20 bp shift). 

In part 7, an indexed matrix of oligonucleotides is created for ev ery pairwtse 
crossover operation. First, all oligonucleotides which have pairwise crossover markers are 
determined. Second, all sets of all oligonucleotides which have die same position and same 
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pair of parents crossover markers (4 per crossover point) are determined. Third, every set of 
4 oligonucleotide strings are taken which have been labeled with the same crossover marker, 
and another derivative set of 4 chimeric oligonucleotide strings comprising of characters 
«» > coding 2 c< picment chains (e.g. with 20 bp shift in 4020+20 scheme) are 
5 made. 2 Coding strings are possible, having a forward end sequence substring of one parent 
followed by the backward end of the second parent after crossover point. Complement 
strings are also designed in the same fashion ei e m indexed complete 

inventory of strings encoding oligonucleotides suitable for gene library assembly by PGR. 

This inventory can further be optionally refined by detecting all redundant 
30 oligonucleotides, counting them and deleting from inventory, accompanied by the 
introduction of the count value to the "abundance«amoant" field in the index of each 
oligonucleotide string. This may be a very beneficial step for reducing total number of 
oligonucleotides for library synthesis, particularly in the cases if parental sequences are 
highly homologous. 

15 Modifications can be made to the methods and materials as hereinbefore 

described without departing from the spirit or scope of fee invention as claimed, and the 

invention can be put to a number of different uses, including: 

The use of an integrated system to generate shuffled nucleic, acids and/or to 

test shuffled nucleic acids, included in an iterative process, 

20 An assay, kit or system utilizing a use of any one of the selec tion strategies, 

materials, components, methods or substrates hereinbefore described. Kits will optionally 

additionally comprise instructions for performing methods or assays, packaging materials, 

one or more containers which contain assay, device or system components, or the like. 

in an additional aspect, the present invention provides kits embodying the 

>a itus herein. Kits of the invention optionally comprise one or more of the 

following: (i) a shuffled component as described herein; (2) instructions for practicing the 

methods described herein, and/or for operating the selection procedure herein; (3) one or 

more assay component; (4) a container for holding nucleic acids or enzymes, other nucleic 

acids, transgenic plants, animals, cells, or the like, (5) packaging materials, and (6) software 

30 for performing any of the process and/or decision steps noted herein. 

In a further aspect, the present invention provides for the use of any 

component or kit herein, for the practice of any method or assay herein, and/or for the use of 

any apparatus or kit to practice any assay or method herein. 
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illustrative purposes only and that various modifications or changes in light thereof will be 
suggested to persons skilled in the art and are to be n f t the spirit and purview of 

this application and scope of the appended claims. AH publications, patents, and patent 
5 applications cited herein are hereby incorporated by reference in their entirety for ali 
purposes. 
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CLAIMS 

What is claimed is: 

1. A method of populating a data structure with a plurality of character 
strings, said method comprising: 

5 i) encoding two or more a biological molecules into character strings 

to provide a collection of two or more different initial character strings wherein each of said 
biological molecules comprises at least about 10 subunits; 

ii) selecting at least two substrings from said character strings; 
Hi) concatenating said substrings to form one or mote product strings 
10 about the same length as one or more of the initial character strings; 

iv) adding the product strings to a collection of strings; and 

v) optionally repeating steps (t) or (ii) through (iv) using one or more 
of said product strings as an initial string in the collection of initial character strings. 

2, The method of claim 1 , wherein said encoding comprises encoding 
15 one or more nucleic acid sequences into said character strings. 

3. The method of claim 2, wherein said one or more nucleic acid 
sequences comprise a nucleic acid sequence encoding a known protein. 

4, The method of claim 1 , wherein said encoding comprises encoding 
one or more amino acid sequences into said character strings, 

20 5, The method of claim 4, wherein said one or more annuo acid 

sequences comprise a nucleic acid sequence encoding a known protein. 

6, The method of claim 1 wherein said ! < es have t 
least 30% sequence identity. 

7. The method of claim 1 , wherein said selecting comprises selecting 

25 substrings such that the ends of said substrings occur in string regions of about 3 to about 20 
characters thai have higher sequence identity with the corres ci t 'gion of another of 
said initial character strings than the overall sequence identity between the same two strings. 
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substrings such that the ends of said substrings occur in predefined motifs of about 4 to about 
8 characters. 

9. The method of claim 1 , wherein said selecting and concatenating 
comprises concatenating substrings from two different initial strings such that the 
concatenation occurs in a region of about three to about tw. i chai e iavi highei 
sequence identity between said two different initial strings than the overall sequence identity 
between said two different initial strings. 

10. The method of claim 1 , wherein said selecting comprises aligning two 
or more of said initial character strings to maximize pairwt.se identity between two or more 
substrings of the character strings, and selecting a character that is a member of an aligned 
pair for the end of one substring. 

1 1. The method of claim 1, wherein said product strings are added to the 
collection only if they have greater than 30% sequence identity with the initial strings. 

12. The method of claim 1 , wherein said method further comprises 
randomly altering one or more characters of said character strings. 

1 3. The method of claim 12, wherein said method further comprises 
randomly selecting and altering one or more occurrences of a particular preselected character 
in said character strings. 

14. A computer program product comprising computer code that 

i) encodes two or more a biological molecules into character strings to 
provide a collection of two or more different initial character strings wherein each of said 
biological molecules comprises at least about ten summits; 

ii) selects at least two substrings from said character strings; 

in) concatenates said substrings to form one or more product strings 
about the same length as one or more of the initial character strings; 

iv) adds the product strings to a collection of strings; and 

v) optionally repeats steps (i) or (ii) through (iv) using one or more of 
said product strings as an initial string in the collection of initial character strings. 
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15. The program of claim 14, wherein said two or more biological 
molecules are nucleic acid sequences. 

1 6. The program of claim 14, wherein said two or more biological 
molecules are nucleic acid sequences of known proteins. 

5 17. The program of claim 14, wherein said two or more biol ogical 

molecules are amino acid sequences 

18. The program of claim 14, wherein said biological molecules have at 
least 30% sequence identity. 

19. The program of chum 14. wherein said code selects substrings such 
10 that the ends of said substrings occur in string regions of about three to about twenty 

characters that have higher sequence identity with the corresponding region of another of 
said initial character strings than the overall sequence identity between the same two strings, 

20. The program of claim 14, wherein said code selects substrings such 
that tire ends of said substrings occur in predefined motifs of about 4 to about 8 characters. 

15 21. The program of claim 14, wherein said code selects and concatenates 

substrings from two different initial strings such that the concatenation occurs in a region of 

res ibout twenty characters h s . - between said two 

different initial strings ihan the overall sequence identity between said two different initial 
strings. 

20 22, The program of claim 14, wherein code selects substrings by aligning 

two or more of said initial character strings to maximize pairwise identity between two or 
more substrings of the character strings, and selecting a character that is a member of an 
aligned pan- for the cud of one substring 

23. The program of claim 14, wherein said product strings are added to 
25 the collection only if they have greater than 30% identity with the initial strings. 

24. The program of claim 14, wherein said method further comprises 
randomly altering one or more characters of said character strings. 
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25. The program of claim 24, wherein said method further comprises 
randomly selecting and altering one or more occurrences of a particular preselected character 
in said character- strings. 

26. The program claim 14, wherein said code is stored on media selected 
5 from the group consisting of magnetic media, optical media, optomagnette media. 

27. The program claim 14, wherein said code is in dynamic- or static 
memory of a computer. 

28. A label generating system for creating a plurality of related labels, said 
labeling system comprising; 

10 an encoder for encoding two or more initial strings from biological 

molecules; 

an isolator for identifying and selecting substrings from said two or 

more strings; 

a concatenator for concatenating said substrings; 
15 a data structure for storing the- concatenated substrings as a collection 

of strings; 

a comparator for measuring the number and variability of the 
collection of strings and determining that sufficient strings exist in the collection of strings; 
and 

20 a command writer for writing the collection of strings into a raw string 

file. 

29. The system of 28, wherein said isolator comprises a comparator for 
aligning and determining regions of identity between said two or more initial strings; 

30. The system of 28, wherein said encoder comprises a means for 
25 encoding a nucleic acid sequence into a character string. 

3 1 . The system of 28. wherein said encoder comprises a means for 
encoding an amino acid sequence into a character string, 
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32. The sys - > n 28, wherein said comparator 'comprises a means 
for calculating sequence identity, 

33. The system of claim 28, wherein said isolator selects substrings such 
that the ends of said substrings occur in string regions of about three to about 100 characters 

5 that have higher sequence identity with the corresponding region of another of said initial 
character strings than the overall sequence identity between the same two strings, 

34. The system of claim 28, wherein said isoiator selects substrings such 
thai the ends of said substrings occur in predefined motifs of about 4 to about 8 characters. 

35. The system of claim 28, wherein said isolator and concatenate!' 

10 individually or in combination concatenate substrings from two different initial strings such 
that the concatenation occurs in a region of about three to about 100 characters having higher 
sequence identity between said two different initial strings than the overall sequence identity 
between said two different initial strings. 

36. The system of claim 28, wherein said isolator aligns two or more of 

1 5 said initial character strings to maximize pairwise identity between two or more substrings of 
the character strings, and selecting a character that is a member of an aligned pair for the end 
of one substring. 

37. The system of claim 28, wherein said comparator adds strings to said 
data structure only if they have greater than 30% identity with the initial strings. 

20 38. The system of claim 28, further comprising an operator to randomly 

altering one or more characters of the character strings. 

39. The system of claim 38, wherein said operator randomly selects and 
alters one or more occurrences of a particular preselected character in said character strings. 

40. The system of claim 28, wherein data structure is a data structure that 
25 stores encoded nucleic acid sequences. 

41 . The system of claim 28, wherein data structure is a data structure that 
stores encoded amino acid sequences. 
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